-- Logs begin at Wed 2022-08-31 11:46:55 UTC, end at Wed 2022-08-31 12:49:43 UTC. -- Aug 31 12:20:55.186065 dv-cinder-855288-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 12:20:55.196381 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 12:20:55.198473 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 12:20:55 2022] *** Aug 31 12:20:55.198473 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 12:20:55.198473 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 12:20:55.198473 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: nodename: dv-cinder-855288-4-iscsi Aug 31 12:20:55.198473 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: machine: x86_64 Aug 31 12:20:55.198473 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: clock source: unix Aug 31 12:20:55.198473 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: pcre jit disabled Aug 31 12:20:55.198473 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: detected number of CPU cores: 4 Aug 31 12:20:55.198473 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: current working directory: / Aug 31 12:20:55.198473 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: detected binary path: /usr/bin/uwsgi-core Aug 31 12:20:55.199251 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: your processes number limit is 47680 Aug 31 12:20:55.199251 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: your memory page size is 4096 bytes Aug 31 12:20:55.199251 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: detected max file descriptor number: 2048 Aug 31 12:20:55.199251 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: lock engine: pthread robust mutexes Aug 31 12:20:55.199251 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: thunder lock: enabled Aug 31 12:20:55.199251 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 12:20:55.199251 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 12:20:55.248310 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: Python main interpreter initialized at 0x564a510c79c0 Aug 31 12:20:55.248310 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: python threads support enabled Aug 31 12:20:55.248310 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: your server socket listen backlog is limited to 100 connections Aug 31 12:20:55.248310 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: your mercy for graceful operations on workers is 90 seconds Aug 31 12:20:55.248763 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 12:20:55.248763 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: *** Operational MODE: preforking *** Aug 31 12:20:55.249032 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: *** uWSGI is running in multiple interpreter mode *** Aug 31 12:20:55.249032 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: spawned uWSGI master process (pid: 105525) Aug 31 12:20:55.249245 dv-cinder-855288-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 12:20:55.250332 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: spawned uWSGI worker 1 (pid: 105526, cores: 1) Aug 31 12:20:55.250332 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: spawned uWSGI worker 2 (pid: 105527, cores: 1) Aug 31 12:20:55.250332 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 12:20:55.927481 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 12:20:55.959661 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 12:20:57.040065 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:20:57.040065 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: from cryptography.utils import int_from_bytes Aug 31 12:20:57.040675 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:20:57.040675 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: from cryptography.utils import int_from_bytes Aug 31 12:20:57.060047 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:20:57.060047 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: from cryptography.utils import int_from_bytes Aug 31 12:20:57.060630 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:20:57.060630 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: from cryptography.utils import int_from_bytes Aug 31 12:20:59.701959 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 12:20:59.702596 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 12:20:59.702596 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 12:20:59.703060 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 12:20:59.703143 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 12:20:59.703226 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 12:20:59.703308 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 12:20:59.703387 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 12:20:59.703460 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 12:20:59.703533 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 12:20:59.703728 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.703837 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.703966 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.704052 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.704286 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.704370 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.704604 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.704692 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.704933 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.705028 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.705240 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.705345 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.705559 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.705657 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.705877 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.705970 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.706198 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.706297 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.706459 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.706550 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.706769 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.706872 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.707114 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855288-4-iscsi {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.707209 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855288-4-iscsi {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.707996 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.708264 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.708362 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.708443 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.708588 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.708675 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.708906 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.709033 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.709208 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.709348 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.709527 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.709659 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.709831 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.709966 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.710330 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.710497 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.711534 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.711668 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.711776 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.711911 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.712045 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.712168 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.712290 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.712428 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.712552 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.712675 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.712804 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.712927 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.713049 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.713177 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.713300 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.713412 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.713545 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.713667 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.713788 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.713920 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.714052 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855288-4-iscsi {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.714182 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855288-4-iscsi {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.714319 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.714450 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.714571 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.714699 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.714831 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.715065 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.715199 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.715343 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.715478 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.715610 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.715784 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.715921 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.716100 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.716226 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.716683 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.716810 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.716992 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.717134 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.717308 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.717439 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.717618 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.717742 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.717933 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.718068 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.718249 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.718374 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.718548 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.718672 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.718878 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.719018 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.719182 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.719308 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.719497 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.719630 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.719800 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.719933 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.720100 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.720225 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.720358 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.720480 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.720643 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.720775 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.720961 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.721087 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.721279 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.721411 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.721595 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.721725 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.721857 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.721985 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.722108 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.722244 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.722370 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.722493 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.722685 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.722824 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.723599 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.723734 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.723937 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.724155 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.724288 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.724542 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.724675 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.724849 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.724975 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.725176 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.725301 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.725453 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.725590 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.725760 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.725886 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.726075 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.726208 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.726388 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.726597 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.726734 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.726937 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.727075 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.727198 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.727327 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.727456 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.727672 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.727796 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.727950 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.728074 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.728257 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.728390 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.728594 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.728726 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.728907 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.729041 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.729212 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.729337 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.729524 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.729650 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.729842 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.729973 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.730151 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.730276 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.730455 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.730579 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.730760 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.730919 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.731098 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.731222 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.731416 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.731546 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.731714 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.731853 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.731976 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.732104 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.732248 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.732378 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.732552 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.732685 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.732857 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.732986 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.733159 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.733282 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.733464 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.733597 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.733769 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.733893 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.734063 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.734185 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.734363 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.734487 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.734665 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.734789 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.734982 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.735106 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.735314 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.735441 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.735564 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.735685 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.735869 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.736002 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.736167 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.736300 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.736464 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.736594 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.736765 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.736889 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.737068 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.737198 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.737379 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.737502 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.737682 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.737812 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.737984 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.738111 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.738287 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.738422 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.738611 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.738741 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.738951 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.739155 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.739282 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.739490 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.739668 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.739808 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.739993 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.740129 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.740297 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.740423 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.740601 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.740727 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.740915 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.741064 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.741224 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.741376 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.741514 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.741644 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.741830 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.741959 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.742127 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.742266 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.742420 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.742589 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.742719 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.742869 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.743047 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.743185 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.743353 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.743493 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.743655 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.743783 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.743971 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.744102 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.744255 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.744399 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.744553 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.744677 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.744852 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.744994 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.745153 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.745302 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.745495 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.745620 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.745749 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.745871 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.746040 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.746167 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.746349 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.746482 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.746654 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.746781 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.746977 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.747106 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.747280 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.747412 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.747601 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:20:59.747759 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.747929 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.748066 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.748256 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.748414 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.748556 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.748698 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.748882 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.749010 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.749209 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.749335 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.749526 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.749661 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.749932 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.750073 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.750204 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.750326 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.750448 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.750583 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.750749 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.750894 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.751082 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.751207 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.751390 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.751529 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.751698 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.751822 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.752013 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.752137 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.752352 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.752493 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.752639 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.752771 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.752951 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.753076 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.753262 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.753397 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.753568 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.753693 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.753879 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.754011 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.754241 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.754371 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.754599 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.754730 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.754963 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.755092 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.755277 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.755405 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.755631 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.755759 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.755948 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.756088 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.756263 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.756383 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.756579 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.756703 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.756891 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.757019 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.757200 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.757326 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.757508 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.757632 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.757823 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.757960 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.758145 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.758271 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.758456 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.758580 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.758774 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.758965 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.759100 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.759223 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.759417 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.759543 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.759728 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.759864 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.760036 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.760163 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.760344 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.760474 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.760652 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.760790 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.760960 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.761087 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.761268 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.761392 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.761589 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.761726 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.761905 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.762044 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.762216 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.762333 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.762528 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.762663 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.762843 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.762991 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.763185 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.763312 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.763496 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.763623 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.763809 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.763941 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.764111 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.764244 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.764414 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.764542 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.764717 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.764842 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.765022 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.765156 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.765331 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.765470 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.765641 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.765777 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.765965 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.766093 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.766270 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.766415 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.766584 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.766681 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.766915 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.767019 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.767226 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.767320 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.767534 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.767642 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.767838 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.767939 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.768140 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.768228 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.768443 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.768537 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.768749 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.768843 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.769056 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.769146 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.769355 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.769451 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.769684 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.769781 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.770572 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.770675 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.770939 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.771042 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.771269 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.771356 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.771580 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.771678 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.771884 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.771972 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.772204 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.772292 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.772516 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.772612 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.772831 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.772917 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.773142 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.773229 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.773451 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.773537 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.773795 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.773900 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.774078 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.774164 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.774394 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.774490 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.774731 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.774943 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.775101 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.775239 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.775382 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.775519 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.775683 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.775930 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.776095 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.776238 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.776386 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.776552 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.776695 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.776919 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.777069 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.777217 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.777353 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.777488 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.777663 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.777868 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.778056 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.778198 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.778333 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.778488 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.778672 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.778814 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.778990 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.779128 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.779263 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.779419 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.779577 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.779715 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.779861 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.780006 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.780148 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.780284 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.780438 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.780574 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.780709 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.780844 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.780979 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.781127 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.781263 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.781399 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.781533 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.781676 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.781818 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.781962 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.782098 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.782247 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.782389 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.782525 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.782659 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.782802 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.783001 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.783140 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.783275 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.783410 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.783556 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.783701 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.783843 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.783985 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.784139 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.784282 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.784430 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.784566 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.784726 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.784879 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.785045 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.785189 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.785366 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.785582 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.786346 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.786445 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.786661 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.786786 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.787129 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.787220 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.787455 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.787544 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.787764 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.787853 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.788081 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.788171 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.788418 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.788513 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.788749 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.788835 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.789067 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.789155 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.789390 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.789482 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.789700 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.789794 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.790019 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.790172 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.790326 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.790434 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.790644 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.790747 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.790971 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.791069 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.791280 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.791369 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.791593 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.791740 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.791909 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.792089 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.792240 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.792377 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.792523 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.792668 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.792828 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.792980 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.793138 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.793313 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.793495 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.793665 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.793817 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.793981 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.794132 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.794277 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.794444 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.794582 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.794719 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.794883 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.795093 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.795265 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.795444 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.795615 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.795754 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.795889 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.796023 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.796158 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.796321 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.796531 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.796672 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.796809 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.796955 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.797098 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.797242 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.797385 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.797521 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.797656 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.797792 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.797939 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.798075 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.798210 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.798344 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.798480 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.798615 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.798767 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.798963 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.799110 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.799256 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.799393 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.799528 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.799709 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.799891 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.800070 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.800208 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.800354 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.800514 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.800717 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.800882 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.801029 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.801717 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.801856 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.802002 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.802137 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.802273 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.802407 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.802542 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.802676 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.802824 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.803002 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.803142 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.803288 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.803425 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.803559 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.803734 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.803886 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.804023 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.804160 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.804336 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.804480 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.804672 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.804814 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.804978 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.805122 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.805267 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.805410 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.805585 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.805735 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.805901 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.806043 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.806207 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.806429 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.806653 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.806795 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.806974 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.807112 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.807270 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.807415 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.807552 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.807693 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.807829 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.807963 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.808097 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.808241 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.808377 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.808512 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.808652 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.808788 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.808931 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.809086 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.809223 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.809365 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.809500 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.809635 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.809806 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.809950 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.810118 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.810262 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.810420 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.810564 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.810731 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.810910 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.811071 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.811208 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.811382 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.811638 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.811953 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.812097 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.812287 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.812429 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.812608 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.812758 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.812929 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.813073 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.813251 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.813396 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.813594 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.813745 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.813925 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.814078 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.814244 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.814396 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.814534 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.814670 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.814845 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.815029 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.815182 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.815329 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.815464 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.815607 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.815765 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.815918 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.816055 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.816196 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.816365 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.816508 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.816707 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.816968 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.817113 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.817264 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.817474 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.817627 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.817772 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.817918 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.818060 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.818204 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.818342 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.818477 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.818612 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.818761 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.818927 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.819098 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.819252 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.819399 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.819543 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.819709 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.819853 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.819996 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.820133 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.820308 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.820463 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.820607 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.820743 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.820886 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.821028 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.821228 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.821391 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.822033 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.822169 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.822358 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.822508 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.822687 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.822841 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.823040 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.823176 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.823342 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.823486 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.823633 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.823781 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.823955 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.824100 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.824258 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.824402 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.824546 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.824682 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.824852 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.825012 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.825150 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.825292 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.825441 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.825578 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.825755 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.825899 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.826062 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.826204 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.826349 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.826486 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.826666 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.826810 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.826991 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.827212 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.827362 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.827505 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.827642 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.827787 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.827922 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.828074 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.828226 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.828370 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.828511 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.828651 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.828792 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.828942 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.829084 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.829226 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.829368 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.829519 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.829667 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.829821 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.829963 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.830105 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.830245 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.830389 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.830605 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.830749 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.830943 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.831095 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.831237 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.831581 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.833291 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.835304 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.836254 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.836407 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.836569 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.836711 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.836864 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.837004 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.837004 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.837004 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.837004 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.837606 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.837759 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.837916 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.838052 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.838186 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.838321 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.838464 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.838600 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.838737 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.838923 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.839068 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.839204 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.839349 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.839485 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.839630 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.839777 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.839945 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.840137 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.840288 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.840426 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.840561 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.840697 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.840833 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.840969 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.841122 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.841260 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.841648 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.841785 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.841931 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.842075 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.842219 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.842355 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.842489 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.842624 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.842758 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.842929 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.843080 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.843217 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.843352 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.843494 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.843640 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.843784 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.843926 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.844062 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.844197 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.844331 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.844466 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.844615 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.844758 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.844894 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.845038 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.845175 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.845317 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.845470 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.845607 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.845743 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.845884 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.846021 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.846164 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.846300 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.846435 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.846570 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.846704 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.846846 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.847053 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.847198 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.847361 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.847578 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.847730 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.847867 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.848114 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.848286 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.848425 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.848568 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.848704 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.848850 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.849003 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.849158 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.849302 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.849449 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.849584 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.849727 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.849864 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.849999 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.850134 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.850270 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.850405 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.850549 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.850685 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.850827 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.851004 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.851144 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.851290 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.851438 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.851580 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.851580 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.851837 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.851971 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.852112 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.852112 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.852381 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.852515 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.852649 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.852790 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.852945 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.853088 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.853222 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.853358 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.853499 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.853634 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.853777 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.853927 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.854070 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.854211 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.854353 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.854496 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.854650 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.854803 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.854991 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.855135 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.855277 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.855419 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.855613 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.855764 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.855906 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.856047 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.856189 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.856343 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.856487 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.856628 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.856787 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.856928 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.857070 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.857219 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.857362 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.857503 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.857738 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.857897 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.858040 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.858040 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.858321 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.858464 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.858617 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.858758 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.858970 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.859123 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.859265 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.859407 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.859555 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.859699 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.859849 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.859991 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.860133 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.860274 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.860421 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.860574 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.860733 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.860933 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.861090 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.861234 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.861375 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.861516 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.861665 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.861809 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.861951 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.862092 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.862242 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.862395 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.862626 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.862778 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.862965 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.863111 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.863252 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.863404 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.864096 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.864256 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.864400 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.864548 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.864703 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.864855 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.864998 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.865150 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.865298 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.865439 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.865579 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.865728 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.865870 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.866013 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.866160 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.866302 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.866443 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.866598 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.866742 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.866930 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.867087 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.867230 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.867380 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.867380 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.867670 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.867916 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.868069 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.868219 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.868362 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.868505 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.868659 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.868803 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.868956 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.869099 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.869240 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.869382 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.869535 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.869686 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.869828 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.869983 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.870127 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.870269 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.870419 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.870570 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.870713 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.870929 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.871088 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.871237 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.871395 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.871547 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.871690 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.871832 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.871982 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.872134 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.872278 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.872427 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.872577 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.872730 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.872871 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.873089 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.873233 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.873383 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.873525 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.873668 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.873809 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.873958 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.874100 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.874242 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.874391 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.874545 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.874705 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.874868 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.875029 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.875172 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.875313 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.875455 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.875605 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.875754 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.875896 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.876044 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.876186 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.876327 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.876482 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.876646 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.876789 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.876789 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.877071 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.877212 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.877366 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.877509 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.877659 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.877802 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.878029 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.878179 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.878330 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.878473 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.878626 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.878768 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.878936 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.879094 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.879320 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.879958 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.880101 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.880244 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.880385 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.880536 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.880680 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.880822 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.880974 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.881127 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.881277 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.881428 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.881572 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.881715 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.881856 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.881996 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.882138 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.882288 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.882430 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.882571 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.882721 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.882915 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.883077 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.883220 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.883363 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.883505 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.883645 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.883795 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.883946 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.884089 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.884231 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.884372 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.884520 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.884663 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.884828 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.884973 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.885115 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.885257 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.885398 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.885552 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.885696 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.885839 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.885981 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.886122 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.886276 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.886427 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.886571 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.886724 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.886890 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.887043 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.887196 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.887352 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.887503 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.887646 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.887789 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.887931 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.888163 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.888322 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.888473 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.888632 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.888774 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.888916 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.889067 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.889217 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.889360 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.889509 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.889652 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.889793 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.889949 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.890093 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.890236 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.890385 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.890539 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.890680 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.890840 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.891011 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.891156 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.891297 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.891439 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.891580 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.891733 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.891877 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.892018 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.892168 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.892310 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.892474 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.892618 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.892759 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.892901 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.893043 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.893192 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.893343 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.893485 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.893627 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.893777 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.893920 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.894061 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.894211 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.894365 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.894507 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.894650 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.894834 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.895077 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.895284 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.895514 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.895744 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.895974 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.896227 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.896480 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.896718 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.896977 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.897139 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.897282 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.897425 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.897578 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.897722 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.897865 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.898006 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.898167 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.898399 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.898559 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.898712 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.898911 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.899071 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.899071 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.899351 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.899495 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.899638 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.899780 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.899921 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.900070 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.900222 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.900365 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.900506 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.900670 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.900813 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.900813 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.901096 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.901096 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.901388 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.901534 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.901677 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.901898 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.902043 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.902192 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.902335 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.902487 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.902630 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.902785 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.903016 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.903189 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.903335 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.903484 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.903636 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.903780 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.903928 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.904071 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.904214 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.904366 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.904517 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.904660 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.904803 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.904944 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.905092 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.905242 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.905393 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.905547 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.905691 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.905834 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.905988 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.906150 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.906301 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.906450 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.906599 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.906742 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.906907 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.906907 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.907199 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.907199 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.907468 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.907609 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.907752 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.907903 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.908063 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.908213 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.908373 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.908588 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.908744 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.908895 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.909039 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.909188 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.909338 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.909487 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.909640 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.909790 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.909941 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.910095 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.910238 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.910379 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.910661 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.910816 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.911037 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.911184 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.911327 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.911468 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.911619 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.911761 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.911903 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.912044 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.912203 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.912358 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.912484 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.912484 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.912654 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.912654 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.912816 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.912910 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.912995 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.913075 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.913180 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.913267 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.913357 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.913449 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.913532 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.913612 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.913692 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.913772 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.913860 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.913950 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.914033 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.914120 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.914209 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.914302 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.914393 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.914522 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.914610 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.914691 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.914772 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.914882 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.914983 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.915070 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.915152 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.915232 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.915312 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.915404 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.915495 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.915577 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.915658 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.915738 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.915819 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.915999 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.916165 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.916320 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.916463 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.916605 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.916746 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.916896 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.917040 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.917188 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.917342 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.917484 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.917632 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.917783 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.917927 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.918069 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.918218 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.918362 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.918504 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.918744 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.918916 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.919067 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.919210 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.919361 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.919505 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.919657 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.919800 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.919942 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.920082 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.920224 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.920374 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.920537 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.920682 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.920823 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.920965 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.921106 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.921265 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.921416 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.921560 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.921702 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.921855 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.921998 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.922149 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.922292 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.922434 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.922583 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.922726 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.922903 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.923065 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.923219 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.923362 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.923510 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.923653 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.923804 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.923977 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.924293 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.924442 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.924638 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.924829 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.924988 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.925162 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.925322 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.925487 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.925643 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.925820 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.925984 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.926679 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.926781 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.927004 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.927109 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.927332 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.927505 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.927651 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.927794 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.927948 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.928088 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.928304 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.928448 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.928589 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.928750 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.928975 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.929125 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.929278 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.929428 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.929570 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.929713 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.929855 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.930009 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.930166 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.930318 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.930461 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.930603 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.930744 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.930950 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.931101 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.931243 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.931385 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.931539 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.931682 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.931848 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.931993 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.932143 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.932300 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.932455 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.932455 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.932742 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.932742 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.933018 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.933168 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.933311 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.933462 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.933622 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.933765 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.933908 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.934050 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.934193 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.934342 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.934485 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.934627 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.934769 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.934934 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.935080 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.935235 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.935387 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.935544 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.935686 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.935828 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.935969 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.936120 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.936262 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.936404 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.936553 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.936725 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.936888 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.937055 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.937206 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.937359 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.937502 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.937671 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.937830 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.937973 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.938123 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.938292 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.938449 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.938601 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.938743 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.938950 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.939166 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.939341 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.939490 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.939642 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.939785 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.939939 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.940082 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.940225 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.940367 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.940518 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.940666 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.940808 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.940950 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.941093 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.941252 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.941407 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.941551 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.941767 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.942432 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.942646 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.942814 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.942985 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.943129 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.943271 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.943422 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.943566 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.943728 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.943871 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.944013 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.944161 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.944303 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.944445 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.944596 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.944752 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.944895 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.945036 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.945177 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.945319 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.945468 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.945628 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.945771 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.945913 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.946054 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.946209 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.946351 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.946493 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.946643 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.946794 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.946973 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.947130 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.947280 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.947422 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.947575 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.947726 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.947868 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.948024 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.948174 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.948316 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.948464 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.948615 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.948758 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.948909 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.949051 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.949284 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.949433 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.949586 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.949737 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.949881 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.950032 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.950183 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.950325 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.950474 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.950630 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.950772 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.950937 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.951083 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.951235 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.951378 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.951538 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.951681 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.951830 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.952018 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.952168 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.952320 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.952482 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.952634 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.952777 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.952919 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.953062 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.953212 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.953369 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.953511 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.953653 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.953802 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.953944 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.954095 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.954239 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.954379 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.954529 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.954681 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.954823 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.955033 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.955179 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.955332 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.955474 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.955624 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.955830 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.955982 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.956127 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.956270 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.956411 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.956554 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.956771 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.956914 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.957056 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.957219 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.957410 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.957555 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.957705 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.957848 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.957997 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.958139 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.958293 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.958445 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.958588 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.958730 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.958895 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.959092 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.959257 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.959487 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.959637 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.959779 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.959921 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.960063 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.960205 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.960359 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.960502 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.960651 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.960800 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.960949 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.961114 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.961257 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.961399 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.961547 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.961689 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.961831 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.961980 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.962124 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.962266 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.962419 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.962563 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.962748 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.962976 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.963125 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.963267 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.963409 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.963551 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.963702 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.963846 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.963988 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 12:20:59.964140 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.964395 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:20:59.964640 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 12:21:00.122589 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO dbcounter [None req-3d25f4e0-a0e6-430a-882d-2a989600d2eb None None] Registered counter for database nova_api Aug 31 12:21:00.144814 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO dbcounter [None req-1d2295a6-cadb-4e1e-ad9c-76e981036e5f None None] Registered counter for database nova_api Aug 31 12:21:00.147886 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG oslo_db.sqlalchemy.engines [None req-3d25f4e0-a0e6-430a-882d-2a989600d2eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105527) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:21:00.154976 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG dbcounter [-] [105527] Writer thread running {{(pid=105527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:21:00.166521 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_db.sqlalchemy.engines [None req-1d2295a6-cadb-4e1e-ad9c-76e981036e5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105526) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:21:00.173318 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG dbcounter [-] [105526] Writer thread running {{(pid=105526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:21:00.212941 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.context [None req-3d25f4e0-a0e6-430a-882d-2a989600d2eb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a65646e1-71cc-4e16-b061-01c594ea7d86(cell1) {{(pid=105527) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 12:21:00.217068 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG oslo_concurrency.lockutils [None req-3d25f4e0-a0e6-430a-882d-2a989600d2eb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:00.217554 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG oslo_concurrency.lockutils [None req-3d25f4e0-a0e6-430a-882d-2a989600d2eb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:00.219173 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG oslo_concurrency.lockutils [None req-3d25f4e0-a0e6-430a-882d-2a989600d2eb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:00.219938 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG oslo_concurrency.lockutils [None req-3d25f4e0-a0e6-430a-882d-2a989600d2eb None None] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:00.220387 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG oslo_concurrency.lockutils [None req-3d25f4e0-a0e6-430a-882d-2a989600d2eb None None] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:00.222422 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG oslo_concurrency.lockutils [None req-3d25f4e0-a0e6-430a-882d-2a989600d2eb None None] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:00.224559 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO dbcounter [None req-3d25f4e0-a0e6-430a-882d-2a989600d2eb None None] Registered counter for database nova_cell0 Aug 31 12:21:00.230422 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO dbcounter [None req-3d25f4e0-a0e6-430a-882d-2a989600d2eb None None] Registered counter for database nova_cell1 Aug 31 12:21:00.231886 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.context [None req-1d2295a6-cadb-4e1e-ad9c-76e981036e5f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a65646e1-71cc-4e16-b061-01c594ea7d86(cell1) {{(pid=105526) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 12:21:00.235987 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-1d2295a6-cadb-4e1e-ad9c-76e981036e5f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:00.236415 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-1d2295a6-cadb-4e1e-ad9c-76e981036e5f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:00.238050 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-1d2295a6-cadb-4e1e-ad9c-76e981036e5f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:00.238883 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-1d2295a6-cadb-4e1e-ad9c-76e981036e5f None None] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:00.239026 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG oslo_db.sqlalchemy.engines [None req-3d25f4e0-a0e6-430a-882d-2a989600d2eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105527) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:21:00.239373 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-1d2295a6-cadb-4e1e-ad9c-76e981036e5f None None] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:00.240235 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG oslo_db.sqlalchemy.engines [None req-3d25f4e0-a0e6-430a-882d-2a989600d2eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105527) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:21:00.241401 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-1d2295a6-cadb-4e1e-ad9c-76e981036e5f None None] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:00.243473 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO dbcounter [None req-1d2295a6-cadb-4e1e-ad9c-76e981036e5f None None] Registered counter for database nova_cell0 Aug 31 12:21:00.247264 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG dbcounter [-] [105527] Writer thread running {{(pid=105527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:21:00.247668 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO dbcounter [None req-1d2295a6-cadb-4e1e-ad9c-76e981036e5f None None] Registered counter for database nova_cell1 Aug 31 12:21:00.248716 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG dbcounter [-] [105527] Writer thread running {{(pid=105527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:21:00.256123 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_db.sqlalchemy.engines [None req-1d2295a6-cadb-4e1e-ad9c-76e981036e5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105526) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:21:00.257490 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_db.sqlalchemy.engines [None req-1d2295a6-cadb-4e1e-ad9c-76e981036e5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105526) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:21:00.264249 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG dbcounter [-] [105526] Writer thread running {{(pid=105526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:21:00.265717 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG dbcounter [-] [105526] Writer thread running {{(pid=105526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:21:00.397273 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO dbcounter [None req-3d25f4e0-a0e6-430a-882d-2a989600d2eb None None] Registered counter for database nova_cell0 Aug 31 12:21:00.406424 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG oslo_db.sqlalchemy.engines [None req-3d25f4e0-a0e6-430a-882d-2a989600d2eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105527) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:21:00.410932 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG dbcounter [-] [105527] Writer thread running {{(pid=105527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:21:00.413488 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO dbcounter [None req-1d2295a6-cadb-4e1e-ad9c-76e981036e5f None None] Registered counter for database nova_cell0 Aug 31 12:21:00.422165 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_db.sqlalchemy.engines [None req-1d2295a6-cadb-4e1e-ad9c-76e981036e5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105526) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:21:00.427325 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG dbcounter [-] [105526] Writer thread running {{(pid=105526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:21:00.753400 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: WARNING keystonemiddleware.auth_token [None req-1d2295a6-cadb-4e1e-ad9c-76e981036e5f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 12:21:00.756841 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: WARNING keystonemiddleware.auth_token [None req-3d25f4e0-a0e6-430a-882d-2a989600d2eb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 12:21:00.761337 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: WARNING keystonemiddleware.auth_token [None req-1d2295a6-cadb-4e1e-ad9c-76e981036e5f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 12:21:00.764592 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: WARNING keystonemiddleware.auth_token [None req-3d25f4e0-a0e6-430a-882d-2a989600d2eb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 12:21:01.107685 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: WARNING keystonemiddleware.auth_token [None req-1d2295a6-cadb-4e1e-ad9c-76e981036e5f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 12:21:01.113829 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: WARNING keystonemiddleware.auth_token [None req-1d2295a6-cadb-4e1e-ad9c-76e981036e5f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 12:21:01.119222 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564a510c79c0 pid: 105526 (default app) Aug 31 12:21:01.121365 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-1d2295a6-cadb-4e1e-ad9c-76e981036e5f None None] Calling method '>' {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:01.122551 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-1d2295a6-cadb-4e1e-ad9c-76e981036e5f None None] 10.222.0.79 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001795 Aug 31 12:21:01.122985 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 1/1] 10.222.0.79 () {50 vars in 788 bytes} [Wed Aug 31 12:21:01 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:21:01.126301 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: WARNING keystonemiddleware.auth_token [None req-3d25f4e0-a0e6-430a-882d-2a989600d2eb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 12:21:01.134079 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: WARNING keystonemiddleware.auth_token [None req-3d25f4e0-a0e6-430a-882d-2a989600d2eb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 12:21:01.140801 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564a510c79c0 pid: 105527 (default app) Aug 31 12:22:26.733318 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-1d2295a6-cadb-4e1e-ad9c-76e981036e5f None None] Calling method '>' {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:26.734376 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-1d2295a6-cadb-4e1e-ad9c-76e981036e5f None None] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 31 12:22:26.735464 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 2/2] 10.222.0.79 () {54 vars in 931 bytes} [Wed Aug 31 12:22:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:22:26.765101 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG dbcounter [-] [105527] Writing DB stats nova_api:SELECT=3 {{(pid=105527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:26.767458 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG dbcounter [-] [105527] Writing DB stats nova_cell1:SELECT=3 {{(pid=105527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:26.769101 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG dbcounter [-] [105527] Writing DB stats nova_cell0:SELECT=3 {{(pid=105527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:26.772878 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG dbcounter [-] [105527] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:28.042193 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-e0133c11-1def-4de3-a855-1c4a64fb242a admin admin] Calling method '>' {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:28.082216 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-e0133c11-1def-4de3-a855-1c4a64fb242a admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.334505 Aug 31 12:22:28.083382 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 1/3] 10.222.0.79 () {60 vars in 1292 bytes} [Wed Aug 31 12:22:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:31.060261 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-1d2295a6-cadb-4e1e-ad9c-76e981036e5f None None] Calling method '>' {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:31.061255 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-1d2295a6-cadb-4e1e-ad9c-76e981036e5f None None] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002474 Aug 31 12:22:31.063207 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 3/4] 10.222.0.79 () {54 vars in 931 bytes} [Wed Aug 31 12:22:31 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:22:31.596447 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-ecefe83a-a11a-4ff8-aa60-3889611eb53f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "c1", "vcpus": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "cirros256", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:31.656828 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-ecefe83a-a11a-4ff8-aa60-3889611eb53f admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.587489 Aug 31 12:22:31.657300 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 2/5] 10.222.0.79 () {64 vars in 1283 bytes} [Wed Aug 31 12:22:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:22:31.676651 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG dbcounter [-] [105526] Writing DB stats nova_api:SELECT=3 {{(pid=105526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:31.678426 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG dbcounter [-] [105526] Writing DB stats nova_cell1:SELECT=3 {{(pid=105526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:31.680173 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG dbcounter [-] [105526] Writing DB stats nova_cell0:SELECT=3 {{(pid=105526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:31.681022 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG dbcounter [-] [105526] Writing DB stats nova_cell0:SELECT=3 {{(pid=105526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:31.896366 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-d21d5536-ad04-4a45-9809-76fe12a8db64 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:31.975251 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-d21d5536-ad04-4a45-9809-76fe12a8db64 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.305149 Aug 31 12:22:31.976314 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 4/6] 10.222.0.79 () {64 vars in 1336 bytes} [Wed Aug 31 12:22:31 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:22:34.588384 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-ecefe83a-a11a-4ff8-aa60-3889611eb53f admin admin] Calling method '>' {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:34.590384 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-ecefe83a-a11a-4ff8-aa60-3889611eb53f admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002686 Aug 31 12:22:34.591450 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 3/7] 10.222.0.79 () {54 vars in 931 bytes} [Wed Aug 31 12:22:34 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:22:35.419542 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-9e829089-1682-4227-a599-f70aa66ec0c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512, "name": "ds512M", "swap": 0, "disk": 5, "id": "d1"}} {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:35.461997 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-9e829089-1682-4227-a599-f70aa66ec0c5 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.858934 Aug 31 12:22:35.467009 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 5/8] 10.222.0.79 () {64 vars in 1283 bytes} [Wed Aug 31 12:22:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:22:35.476184 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-976bf231-9e21-4229-aec1-04fbb4ba42dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:35.526238 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-976bf231-9e21-4229-aec1-04fbb4ba42dd admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.054472 Aug 31 12:22:35.531151 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 4/9] 10.222.0.79 () {64 vars in 1336 bytes} [Wed Aug 31 12:22:35 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:38.350971 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-9e829089-1682-4227-a599-f70aa66ec0c5 admin admin] Calling method '>' {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:38.351998 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-9e829089-1682-4227-a599-f70aa66ec0c5 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 31 12:22:38.352407 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 6/10] 10.222.0.79 () {54 vars in 931 bytes} [Wed Aug 31 12:22:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:22:38.863652 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-63488d7a-fad2-4549-bc3a-bd82aea76138 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 1024, "id": "d2"}} {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:38.884094 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-63488d7a-fad2-4549-bc3a-bd82aea76138 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.524331 Aug 31 12:22:38.884702 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 5/11] 10.222.0.79 () {64 vars in 1283 bytes} [Wed Aug 31 12:22:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:22:38.897887 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-c6ea955a-5783-4fe8-b79c-e13efc5373ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:38.929574 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-c6ea955a-5783-4fe8-b79c-e13efc5373ce admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036448 Aug 31 12:22:38.930151 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 7/12] 10.222.0.79 () {64 vars in 1336 bytes} [Wed Aug 31 12:22:38 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:41.490886 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-63488d7a-fad2-4549-bc3a-bd82aea76138 admin admin] Calling method '>' {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:41.491653 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-63488d7a-fad2-4549-bc3a-bd82aea76138 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001722 Aug 31 12:22:41.491919 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 6/13] 10.222.0.79 () {54 vars in 931 bytes} [Wed Aug 31 12:22:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:22:42.076390 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-c134dbe9-7c4e-4256-ae74-0cf8fd5f57a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 10, "ram": 2048, "rxtx_factor": 1.0, "name": "ds2G", "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:42.107890 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-c134dbe9-7c4e-4256-ae74-0cf8fd5f57a7 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.609005 Aug 31 12:22:42.110126 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 8/14] 10.222.0.79 () {64 vars in 1283 bytes} [Wed Aug 31 12:22:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:22:42.131212 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-c5147c84-be2c-4803-b3da-c0c59eaa0302 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:42.161636 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-c5147c84-be2c-4803-b3da-c0c59eaa0302 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039418 Aug 31 12:22:42.162392 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 7/15] 10.222.0.79 () {64 vars in 1336 bytes} [Wed Aug 31 12:22:42 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:44.871191 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-c134dbe9-7c4e-4256-ae74-0cf8fd5f57a7 admin admin] Calling method '>' {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:44.872829 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-c134dbe9-7c4e-4256-ae74-0cf8fd5f57a7 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002108 Aug 31 12:22:44.873241 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 9/16] 10.222.0.79 () {54 vars in 931 bytes} [Wed Aug 31 12:22:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:22:45.411950 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-401df1ae-d800-406b-aa4c-6484a327f7dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds4G", "ram": 4096, "swap": 0, "vcpus": 4}} {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:45.434955 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-401df1ae-d800-406b-aa4c-6484a327f7dd admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.554742 Aug 31 12:22:45.435748 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 8/17] 10.222.0.79 () {64 vars in 1283 bytes} [Wed Aug 31 12:22:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:22:45.451767 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-3a8dd61c-86de-4e9b-8f5d-af71675113e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:45.485602 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-3a8dd61c-86de-4e9b-8f5d-af71675113e5 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038473 Aug 31 12:22:45.490670 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 10/18] 10.222.0.79 () {64 vars in 1336 bytes} [Wed Aug 31 12:22:45 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:48.158466 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-401df1ae-d800-406b-aa4c-6484a327f7dd admin admin] Calling method '>' {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:48.159749 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-401df1ae-d800-406b-aa4c-6484a327f7dd admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001598 Aug 31 12:22:48.160201 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 9/19] 10.222.0.79 () {54 vars in 931 bytes} [Wed Aug 31 12:22:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:22:48.728906 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-4f4f6d23-e4f6-4cc2-8fe0-fc2f61262325 admin admin] Calling method '>' {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:48.772110 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-4f4f6d23-e4f6-4cc2-8fe0-fc2f61262325 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.603542 Aug 31 12:22:48.772932 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 11/20] 10.222.0.79 () {60 vars in 1292 bytes} [Wed Aug 31 12:22:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:22:51.521236 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-401df1ae-d800-406b-aa4c-6484a327f7dd admin admin] Calling method '>' {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:51.523189 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-401df1ae-d800-406b-aa4c-6484a327f7dd admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002359 Aug 31 12:22:51.524003 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 10/21] 10.222.0.79 () {54 vars in 931 bytes} [Wed Aug 31 12:22:51 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:22:52.072474 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-0ef0e334-dd4e-4b0c-9c9e-c2ff401d0be5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "id": "1"}} {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:52.095914 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-0ef0e334-dd4e-4b0c-9c9e-c2ff401d0be5 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.565025 Aug 31 12:22:52.097566 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 12/22] 10.222.0.79 () {64 vars in 1283 bytes} [Wed Aug 31 12:22:51 2022] POST /compute/v2.1/flavors => generated 402 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:22:52.113995 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-b175d1f1-96fc-4a1c-9f25-ab46d115cc74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:52.155664 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-b175d1f1-96fc-4a1c-9f25-ab46d115cc74 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047997 Aug 31 12:22:52.156477 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 11/23] 10.222.0.79 () {64 vars in 1333 bytes} [Wed Aug 31 12:22:52 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:55.089146 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-0ef0e334-dd4e-4b0c-9c9e-c2ff401d0be5 admin admin] Calling method '>' {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:55.090042 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-0ef0e334-dd4e-4b0c-9c9e-c2ff401d0be5 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 31 12:22:55.090437 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 13/24] 10.222.0.79 () {54 vars in 931 bytes} [Wed Aug 31 12:22:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:22:55.578303 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-88e90499-0949-4f6f-91fe-e0d807066b0b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "2", "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 20, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:55.600581 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-88e90499-0949-4f6f-91fe-e0d807066b0b admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.503276 Aug 31 12:22:55.601260 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 12/25] 10.222.0.79 () {64 vars in 1283 bytes} [Wed Aug 31 12:22:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:22:55.614624 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-b209a1b8-759c-4845-8064-6479e554beab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:55.646394 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-b209a1b8-759c-4845-8064-6479e554beab admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036044 Aug 31 12:22:55.647180 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 14/26] 10.222.0.79 () {64 vars in 1333 bytes} [Wed Aug 31 12:22:55 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:58.246642 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-88e90499-0949-4f6f-91fe-e0d807066b0b admin admin] Calling method '>' {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:58.249064 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-88e90499-0949-4f6f-91fe-e0d807066b0b admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003047 Aug 31 12:22:58.258896 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 13/27] 10.222.0.79 () {54 vars in 931 bytes} [Wed Aug 31 12:22:58 2022] GET /compute/v2.1 => generated 388 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:22:58.855286 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-311f0e8d-0634-45d1-bdae-6edf23f48f59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "3", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "disk": 40, "name": "m1.medium"}} {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:58.881215 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-311f0e8d-0634-45d1-bdae-6edf23f48f59 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.620717 Aug 31 12:22:58.882372 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 15/28] 10.222.0.79 () {64 vars in 1283 bytes} [Wed Aug 31 12:22:58 2022] POST /compute/v2.1/flavors => generated 406 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:22:58.904090 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-2ac98d93-ffab-493e-b996-1e6062053003 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:58.912358 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG dbcounter [-] [105527] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:58.934763 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-2ac98d93-ffab-493e-b996-1e6062053003 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037798 Aug 31 12:22:58.935389 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 14/29] 10.222.0.79 () {64 vars in 1333 bytes} [Wed Aug 31 12:22:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:01.703438 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-311f0e8d-0634-45d1-bdae-6edf23f48f59 admin admin] Calling method '>' {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:01.704358 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-311f0e8d-0634-45d1-bdae-6edf23f48f59 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Aug 31 12:23:01.704839 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 16/30] 10.222.0.79 () {54 vars in 931 bytes} [Wed Aug 31 12:23:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:02.320926 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-0967362f-6d09-4ed7-916b-a65e29cecd71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "disk": 80, "vcpus": 4, "rxtx_factor": 1.0, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.large"}} {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:23:02.364957 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-0967362f-6d09-4ed7-916b-a65e29cecd71 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.650421 Aug 31 12:23:02.366426 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 15/31] 10.222.0.79 () {64 vars in 1283 bytes} [Wed Aug 31 12:23:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:02.379812 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-8142dd31-9ded-4281-8598-6b387eb17d7c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:23:02.398447 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG dbcounter [-] [105526] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=105526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:02.419744 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-8142dd31-9ded-4281-8598-6b387eb17d7c admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044700 Aug 31 12:23:02.431272 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 17/32] 10.222.0.79 () {64 vars in 1333 bytes} [Wed Aug 31 12:23:02 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:05.022322 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-0967362f-6d09-4ed7-916b-a65e29cecd71 admin admin] Calling method '>' {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:05.023797 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-0967362f-6d09-4ed7-916b-a65e29cecd71 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 31 12:23:05.024504 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 16/33] 10.222.0.79 () {54 vars in 931 bytes} [Wed Aug 31 12:23:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:05.528737 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-35b07e9f-720b-426e-b2d4-99dc0c3f373c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "5", "disk": 160, "name": "m1.xlarge", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:23:05.550398 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-35b07e9f-720b-426e-b2d4-99dc0c3f373c admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.519440 Aug 31 12:23:05.551391 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 18/34] 10.222.0.79 () {64 vars in 1283 bytes} [Wed Aug 31 12:23:05 2022] POST /compute/v2.1/flavors => generated 408 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:23:05.565348 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-a89229af-2c71-4ec3-a1f9-e7c23b840824 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:23:05.591582 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-a89229af-2c71-4ec3-a1f9-e7c23b840824 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030005 Aug 31 12:23:05.592175 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 17/35] 10.222.0.79 () {64 vars in 1333 bytes} [Wed Aug 31 12:23:05 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:23.310408 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-35b07e9f-720b-426e-b2d4-99dc0c3f373c admin admin] Calling method '>' {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:23.311470 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-35b07e9f-720b-426e-b2d4-99dc0c3f373c admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Aug 31 12:23:23.311878 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 19/36] 10.222.0.79 () {54 vars in 931 bytes} [Wed Aug 31 12:23:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:23.323177 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG dbcounter [-] [105527] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:23.719396 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-209267cc-aaa8-4980-8c75-22055fa27e9a admin admin] Calling method '>' {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:23.738725 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-209267cc-aaa8-4980-8c75-22055fa27e9a admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.419887 Aug 31 12:23:23.739333 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 18/37] 10.222.0.79 () {60 vars in 1292 bytes} [Wed Aug 31 12:23:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:23:24.848424 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-35b07e9f-720b-426e-b2d4-99dc0c3f373c admin admin] Calling method '>' {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:24.849308 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-35b07e9f-720b-426e-b2d4-99dc0c3f373c admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Aug 31 12:23:24.849718 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 20/38] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Aug 31 12:23:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:23:25.400560 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-0f8a2fff-42cc-448c-82f1-e1175a433145 admin admin] Calling method '>' {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:25.406371 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.wsgi [None req-0f8a2fff-42cc-448c-82f1-e1175a433145 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 12:23:25.409811 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-0f8a2fff-42cc-448c-82f1-e1175a433145 admin admin] Request method failure captured: Aug 31 12:23:25.409811 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 12:23:25.409811 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: Accept: application/json Aug 31 12:23:25.409811 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: Accept-Encoding: gzip, deflate Aug 31 12:23:25.409811 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: Connection: keep-alive Aug 31 12:23:25.409811 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: Content-Length: 0 Aug 31 12:23:25.409811 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: Host: 10.222.0.79 Aug 31 12:23:25.409811 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: Openstack-Api-Version: compute 2.90 Aug 31 12:23:25.409811 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: Openstack-System-Scope: None Aug 31 12:23:25.409811 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: User-Agent: python-novaclient Aug 31 12:23:25.409811 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Auth-Token: gAAAAABjD1K8zEldy_6M5ZcZwXOZk84iNQtjOtS6-ua8VyF67OSGhTDp6RypehIEnz9ZOf3LObDYUF2Stxo6SS-K3ocGOrWUMOKFdyc60r8F4QmdkdHJYZsI-4xKNxtZI3R2nrm-4PdAAyRxCdjdlMlQZOlgsCtR6P3_VbcOKXfxW2EA5QObthc Aug 31 12:23:25.409811 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Domain-Id: None Aug 31 12:23:25.409811 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Domain-Name: None Aug 31 12:23:25.409811 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Identity-Status: Confirmed Aug 31 12:23:25.409811 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Is-Admin-Project: True Aug 31 12:23:25.409811 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 12:23:25.409811 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Project-Domain-Id: default Aug 31 12:23:25.409811 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Project-Domain-Name: Default Aug 31 12:23:25.409811 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Project-Id: 088123e0cad144f3a713fb6c4c75d880 Aug 31 12:23:25.409811 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Project-Name: admin Aug 31 12:23:25.409811 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Role: reader,member,admin Aug 31 12:23:25.409811 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Roles: reader,member,admin Aug 31 12:23:25.411535 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/088123e0cad144f3a713fb6c4c75d880"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_088123e0cad144f3a713fb6c4c75d880", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/088123e0cad144f3a713fb6c4c75d880"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/088123e0cad144f3a713fb6c4c75d880"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:23:25.411535 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Tenant: admin Aug 31 12:23:25.411535 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Tenant-Id: 088123e0cad144f3a713fb6c4c75d880 Aug 31 12:23:25.411535 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Tenant-Name: admin Aug 31 12:23:25.411535 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-User: admin Aug 31 12:23:25.411535 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-User-Domain-Id: default Aug 31 12:23:25.411535 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-User-Domain-Name: Default Aug 31 12:23:25.411535 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-User-Id: ba867dda5cc7471abb8f3da6ca94b58a Aug 31 12:23:25.411535 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-User-Name: admin Aug 31 12:23:25.411535 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: method: > Aug 31 12:23:25.411535 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: exception: Flavor 42 could not be found. Aug 31 12:23:25.411535 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: action_args: {'id': '42'} Aug 31 12:23:25.411535 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:23:25.411535 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:23:25.412538 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 12:23:25.412538 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 12:23:25.412538 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 12:23:25.412538 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 12:23:25.412538 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 12:23:25.412538 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 12:23:25.412538 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 12:23:25.412538 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 12:23:25.412538 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 12:23:25.412538 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:23:25.412538 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 12:23:25.412538 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 12:23:25.412538 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 12:23:25.412538 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi Aug 31 12:23:25.412538 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:23:25.412538 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi Aug 31 12:23:25.412538 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:23:25.412538 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:23:25.412538 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:23:25.413959 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:23:25.413959 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:23:25.413959 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:23:25.413959 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:23:25.413959 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 12:23:25.413959 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:23:25.413959 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 12:23:25.413959 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi Aug 31 12:23:25.413959 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:23:25.413959 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi Aug 31 12:23:25.413959 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:23:25.413959 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:23:25.413959 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:23:25.413959 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:23:25.413959 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:23:25.413959 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 12:23:25.413959 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi Aug 31 12:23:25.413959 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-0f8a2fff-42cc-448c-82f1-e1175a433145 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:23:25.415316 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-0f8a2fff-42cc-448c-82f1-e1175a433145 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.422872 Aug 31 12:23:25.415316 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 19/39] 10.222.0.79 () {60 vars in 1190 bytes} [Wed Aug 31 12:23:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 425 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 12:23:25.421204 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-0c08b292-eec4-4f6a-ad53-063197cddf45 admin admin] Calling method '>' {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:25.425770 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG dbcounter [-] [105526] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=105526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:25.447199 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-0c08b292-eec4-4f6a-ad53-063197cddf45 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029544 Aug 31 12:23:25.447771 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 21/40] 10.222.0.79 () {60 vars in 1210 bytes} [Wed Aug 31 12:23:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:23:25.457861 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-b7c116b6-61e7-40fd-8613-b80f769e0510 admin admin] Calling method '>' {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:25.482092 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-b7c116b6-61e7-40fd-8613-b80f769e0510 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027810 Aug 31 12:23:25.482648 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 20/41] 10.222.0.79 () {60 vars in 1210 bytes} [Wed Aug 31 12:23:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:23:25.493290 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-292bda2d-31b6-4f43-bb1a-01797add1000 admin admin] Calling method '>' {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:25.499828 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.wsgi [None req-292bda2d-31b6-4f43-bb1a-01797add1000 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 12:23:25.503696 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-292bda2d-31b6-4f43-bb1a-01797add1000 admin admin] Request method failure captured: Aug 31 12:23:25.503696 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 12:23:25.503696 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: Accept: application/json Aug 31 12:23:25.503696 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: Accept-Encoding: gzip, deflate Aug 31 12:23:25.503696 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: Connection: keep-alive Aug 31 12:23:25.503696 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: Content-Length: 0 Aug 31 12:23:25.503696 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: Host: 10.222.0.79 Aug 31 12:23:25.503696 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: Openstack-Api-Version: compute 2.90 Aug 31 12:23:25.503696 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: Openstack-System-Scope: None Aug 31 12:23:25.503696 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: User-Agent: python-novaclient Aug 31 12:23:25.503696 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Auth-Token: gAAAAABjD1K8zEldy_6M5ZcZwXOZk84iNQtjOtS6-ua8VyF67OSGhTDp6RypehIEnz9ZOf3LObDYUF2Stxo6SS-K3ocGOrWUMOKFdyc60r8F4QmdkdHJYZsI-4xKNxtZI3R2nrm-4PdAAyRxCdjdlMlQZOlgsCtR6P3_VbcOKXfxW2EA5QObthc Aug 31 12:23:25.503696 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Domain-Id: None Aug 31 12:23:25.503696 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Domain-Name: None Aug 31 12:23:25.503696 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Identity-Status: Confirmed Aug 31 12:23:25.503696 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Is-Admin-Project: True Aug 31 12:23:25.503696 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 12:23:25.503696 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Project-Domain-Id: default Aug 31 12:23:25.503696 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Project-Domain-Name: Default Aug 31 12:23:25.503696 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Project-Id: 088123e0cad144f3a713fb6c4c75d880 Aug 31 12:23:25.503696 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Project-Name: admin Aug 31 12:23:25.503696 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Role: reader,member,admin Aug 31 12:23:25.503696 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Roles: reader,member,admin Aug 31 12:23:25.506089 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/088123e0cad144f3a713fb6c4c75d880"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_088123e0cad144f3a713fb6c4c75d880", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/088123e0cad144f3a713fb6c4c75d880"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/088123e0cad144f3a713fb6c4c75d880"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:23:25.506089 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Tenant: admin Aug 31 12:23:25.506089 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Tenant-Id: 088123e0cad144f3a713fb6c4c75d880 Aug 31 12:23:25.506089 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Tenant-Name: admin Aug 31 12:23:25.506089 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-User: admin Aug 31 12:23:25.506089 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-User-Domain-Id: default Aug 31 12:23:25.506089 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-User-Domain-Name: Default Aug 31 12:23:25.506089 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-User-Id: ba867dda5cc7471abb8f3da6ca94b58a Aug 31 12:23:25.506089 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-User-Name: admin Aug 31 12:23:25.506089 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: method: > Aug 31 12:23:25.506089 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: exception: Flavor 42 could not be found. Aug 31 12:23:25.506089 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: action_args: {'id': '42'} Aug 31 12:23:25.506089 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:23:25.506089 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:23:25.507452 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 12:23:25.507452 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 12:23:25.507452 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 12:23:25.507452 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 12:23:25.507452 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 12:23:25.507452 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 12:23:25.507452 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 12:23:25.507452 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 12:23:25.507452 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 12:23:25.507452 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:23:25.507452 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 12:23:25.507452 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 12:23:25.507452 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 12:23:25.507452 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi Aug 31 12:23:25.507452 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:23:25.507452 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi Aug 31 12:23:25.507452 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:23:25.507452 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:23:25.507452 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:23:25.508516 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:23:25.508516 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:23:25.508516 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:23:25.508516 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:23:25.508516 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 12:23:25.508516 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:23:25.508516 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 12:23:25.508516 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi Aug 31 12:23:25.508516 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:23:25.508516 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi Aug 31 12:23:25.508516 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:23:25.508516 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:23:25.508516 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:23:25.508516 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:23:25.508516 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:23:25.508516 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 12:23:25.508516 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi Aug 31 12:23:25.508516 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-292bda2d-31b6-4f43-bb1a-01797add1000 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:23:25.509529 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-292bda2d-31b6-4f43-bb1a-01797add1000 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016063 Aug 31 12:23:25.509529 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 22/42] 10.222.0.79 () {60 vars in 1190 bytes} [Wed Aug 31 12:23:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 12:23:26.500430 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-b7c116b6-61e7-40fd-8613-b80f769e0510 admin admin] Calling method '>' {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:26.501432 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-b7c116b6-61e7-40fd-8613-b80f769e0510 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 31 12:23:26.501827 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 21/43] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Aug 31 12:23:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:27.054400 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-689f7683-df0f-4772-b9d9-896c644ff0a2 admin admin] Calling method '>' {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:27.061052 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.wsgi [None req-689f7683-df0f-4772-b9d9-896c644ff0a2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 12:23:27.062833 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-689f7683-df0f-4772-b9d9-896c644ff0a2 admin admin] Request method failure captured: Aug 31 12:23:27.062833 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 12:23:27.062833 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: Accept: application/json Aug 31 12:23:27.062833 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: Accept-Encoding: gzip, deflate Aug 31 12:23:27.062833 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: Connection: keep-alive Aug 31 12:23:27.062833 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: Content-Length: 0 Aug 31 12:23:27.062833 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: Host: 10.222.0.79 Aug 31 12:23:27.062833 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: Openstack-Api-Version: compute 2.90 Aug 31 12:23:27.062833 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: Openstack-System-Scope: None Aug 31 12:23:27.062833 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: User-Agent: python-novaclient Aug 31 12:23:27.062833 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Auth-Token: gAAAAABjD1K-Hdd_ZpmEMMLDLg3R5_fEQWFMoy5IVnWJaLdT3s0NgGRUwdMU2nfoLEB8d7enHSP4ZpGjt7rlvBpm76M3oORaGvcDFpi0UvPLMiO5bi-7n28acF7c5r4zkRH2lyuVBgOZI7O38xAsf4oxdwg4gcnYHUxRQzAaWxs2WyEhloQM1Gk Aug 31 12:23:27.062833 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Domain-Id: None Aug 31 12:23:27.062833 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Domain-Name: None Aug 31 12:23:27.062833 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Identity-Status: Confirmed Aug 31 12:23:27.062833 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Is-Admin-Project: True Aug 31 12:23:27.062833 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 12:23:27.062833 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Project-Domain-Id: default Aug 31 12:23:27.062833 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Project-Domain-Name: Default Aug 31 12:23:27.062833 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Project-Id: 088123e0cad144f3a713fb6c4c75d880 Aug 31 12:23:27.062833 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Project-Name: admin Aug 31 12:23:27.062833 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Role: reader,member,admin Aug 31 12:23:27.062833 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Roles: reader,member,admin Aug 31 12:23:27.064423 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/088123e0cad144f3a713fb6c4c75d880"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_088123e0cad144f3a713fb6c4c75d880", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/088123e0cad144f3a713fb6c4c75d880"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/088123e0cad144f3a713fb6c4c75d880"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:23:27.064423 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Tenant: admin Aug 31 12:23:27.064423 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Tenant-Id: 088123e0cad144f3a713fb6c4c75d880 Aug 31 12:23:27.064423 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Tenant-Name: admin Aug 31 12:23:27.064423 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-User: admin Aug 31 12:23:27.064423 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-User-Domain-Id: default Aug 31 12:23:27.064423 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-User-Domain-Name: Default Aug 31 12:23:27.064423 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-User-Id: ba867dda5cc7471abb8f3da6ca94b58a Aug 31 12:23:27.064423 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-User-Name: admin Aug 31 12:23:27.064423 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: method: > Aug 31 12:23:27.064423 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: exception: Flavor 84 could not be found. Aug 31 12:23:27.064423 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: action_args: {'id': '84'} Aug 31 12:23:27.064423 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:23:27.064423 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:23:27.065278 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 12:23:27.065278 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 12:23:27.065278 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 12:23:27.065278 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 12:23:27.065278 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 12:23:27.065278 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 12:23:27.065278 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 12:23:27.065278 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 12:23:27.065278 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 12:23:27.065278 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:23:27.065278 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 12:23:27.065278 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 12:23:27.065278 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 12:23:27.065278 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi Aug 31 12:23:27.065278 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:23:27.065278 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi Aug 31 12:23:27.065278 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:23:27.065278 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:23:27.065278 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:23:27.068165 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:23:27.068165 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:23:27.068165 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:23:27.068165 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:23:27.068165 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 12:23:27.068165 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:23:27.068165 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 12:23:27.068165 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi Aug 31 12:23:27.068165 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:23:27.068165 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi Aug 31 12:23:27.068165 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:23:27.068165 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:23:27.068165 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:23:27.068165 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:23:27.068165 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:23:27.068165 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 12:23:27.068165 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi Aug 31 12:23:27.068165 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-689f7683-df0f-4772-b9d9-896c644ff0a2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:23:27.069523 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-689f7683-df0f-4772-b9d9-896c644ff0a2 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.423057 Aug 31 12:23:27.069523 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 23/44] 10.222.0.79 () {60 vars in 1190 bytes} [Wed Aug 31 12:23:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 424 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 12:23:27.074796 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-a5563cd6-9768-40ad-a5da-49c504b26cdd admin admin] Calling method '>' {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:27.091114 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-a5563cd6-9768-40ad-a5da-49c504b26cdd admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019854 Aug 31 12:23:27.091667 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 22/45] 10.222.0.79 () {60 vars in 1210 bytes} [Wed Aug 31 12:23:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:23:27.102253 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-11a2ba98-5722-4b5f-831c-e8f896e8e748 admin admin] Calling method '>' {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:27.118676 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-11a2ba98-5722-4b5f-831c-e8f896e8e748 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020025 Aug 31 12:23:27.119269 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 24/46] 10.222.0.79 () {60 vars in 1210 bytes} [Wed Aug 31 12:23:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:23:27.129058 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-fcc09d4a-b466-4643-811b-fcf71722f49d admin admin] Calling method '>' {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:27.136786 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.wsgi [None req-fcc09d4a-b466-4643-811b-fcf71722f49d admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 12:23:27.138439 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-fcc09d4a-b466-4643-811b-fcf71722f49d admin admin] Request method failure captured: Aug 31 12:23:27.138439 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 12:23:27.138439 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: Accept: application/json Aug 31 12:23:27.138439 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: Accept-Encoding: gzip, deflate Aug 31 12:23:27.138439 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: Connection: keep-alive Aug 31 12:23:27.138439 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: Content-Length: 0 Aug 31 12:23:27.138439 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: Host: 10.222.0.79 Aug 31 12:23:27.138439 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: Openstack-Api-Version: compute 2.90 Aug 31 12:23:27.138439 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: Openstack-System-Scope: None Aug 31 12:23:27.138439 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: User-Agent: python-novaclient Aug 31 12:23:27.138439 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Auth-Token: gAAAAABjD1K-Hdd_ZpmEMMLDLg3R5_fEQWFMoy5IVnWJaLdT3s0NgGRUwdMU2nfoLEB8d7enHSP4ZpGjt7rlvBpm76M3oORaGvcDFpi0UvPLMiO5bi-7n28acF7c5r4zkRH2lyuVBgOZI7O38xAsf4oxdwg4gcnYHUxRQzAaWxs2WyEhloQM1Gk Aug 31 12:23:27.138439 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Domain-Id: None Aug 31 12:23:27.138439 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Domain-Name: None Aug 31 12:23:27.138439 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Identity-Status: Confirmed Aug 31 12:23:27.138439 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Is-Admin-Project: True Aug 31 12:23:27.138439 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 12:23:27.138439 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Project-Domain-Id: default Aug 31 12:23:27.138439 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Project-Domain-Name: Default Aug 31 12:23:27.138439 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Project-Id: 088123e0cad144f3a713fb6c4c75d880 Aug 31 12:23:27.138439 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Project-Name: admin Aug 31 12:23:27.138439 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Role: reader,member,admin Aug 31 12:23:27.138439 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Roles: reader,member,admin Aug 31 12:23:27.140150 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/088123e0cad144f3a713fb6c4c75d880"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_088123e0cad144f3a713fb6c4c75d880", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/088123e0cad144f3a713fb6c4c75d880"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/088123e0cad144f3a713fb6c4c75d880"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:23:27.140150 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Tenant: admin Aug 31 12:23:27.140150 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Tenant-Id: 088123e0cad144f3a713fb6c4c75d880 Aug 31 12:23:27.140150 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Tenant-Name: admin Aug 31 12:23:27.140150 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-User: admin Aug 31 12:23:27.140150 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-User-Domain-Id: default Aug 31 12:23:27.140150 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-User-Domain-Name: Default Aug 31 12:23:27.140150 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-User-Id: ba867dda5cc7471abb8f3da6ca94b58a Aug 31 12:23:27.140150 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-User-Name: admin Aug 31 12:23:27.140150 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: method: > Aug 31 12:23:27.140150 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: exception: Flavor 84 could not be found. Aug 31 12:23:27.140150 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: action_args: {'id': '84'} Aug 31 12:23:27.140150 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:23:27.140150 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:23:27.141245 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 12:23:27.141245 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 12:23:27.141245 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 12:23:27.141245 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 12:23:27.141245 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 12:23:27.141245 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 12:23:27.141245 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 12:23:27.141245 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 12:23:27.141245 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 12:23:27.141245 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:23:27.141245 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 12:23:27.141245 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 12:23:27.141245 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 12:23:27.141245 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi Aug 31 12:23:27.141245 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:23:27.141245 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi Aug 31 12:23:27.141245 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:23:27.141245 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:23:27.141245 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:23:27.142667 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:23:27.142667 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:23:27.142667 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:23:27.142667 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:23:27.142667 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 12:23:27.142667 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:23:27.142667 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 12:23:27.142667 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi Aug 31 12:23:27.142667 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:23:27.142667 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi Aug 31 12:23:27.142667 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:23:27.142667 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:23:27.142667 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:23:27.142667 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:23:27.142667 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:23:27.142667 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 12:23:27.142667 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi Aug 31 12:23:27.142667 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-fcc09d4a-b466-4643-811b-fcf71722f49d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:23:27.144257 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-fcc09d4a-b466-4643-811b-fcf71722f49d admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.014473 Aug 31 12:23:27.144257 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 23/47] 10.222.0.79 () {60 vars in 1190 bytes} [Wed Aug 31 12:23:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 31 12:23:28.164107 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-11a2ba98-5722-4b5f-831c-e8f896e8e748 admin admin] Calling method '>' {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:28.165124 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-11a2ba98-5722-4b5f-831c-e8f896e8e748 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 31 12:23:28.165521 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 25/48] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Aug 31 12:23:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:28.729901 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-eb01d7d3-9554-4167-81c1-c3b87a027c7a admin admin] Calling method '>' {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:28.735924 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.wsgi [None req-eb01d7d3-9554-4167-81c1-c3b87a027c7a admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 12:23:28.738003 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-eb01d7d3-9554-4167-81c1-c3b87a027c7a admin admin] Request method failure captured: Aug 31 12:23:28.738003 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 12:23:28.738003 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: Accept: application/json Aug 31 12:23:28.738003 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: Accept-Encoding: gzip, deflate Aug 31 12:23:28.738003 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: Connection: keep-alive Aug 31 12:23:28.738003 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: Content-Length: 0 Aug 31 12:23:28.738003 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: Host: 10.222.0.79 Aug 31 12:23:28.738003 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: Openstack-Api-Version: compute 2.90 Aug 31 12:23:28.738003 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: Openstack-System-Scope: None Aug 31 12:23:28.738003 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: User-Agent: python-novaclient Aug 31 12:23:28.738003 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Auth-Token: gAAAAABjD1LAPfCcOYBvPaL-ZaBpNt7a3yqOfrCMXl2RC21Q8Jam-GCY3J3LfKi_ro_Fa-7xYpR53rVSdEuJNLl8A5BvVo4WtINtlEnQDNxawcdDwbquCBO5fvcM22WrFoEM1bpMe9TZJc6rSeL4oRhEjWBuhRzRTvB1YZQVpE6Q_DTxPqk-Hms Aug 31 12:23:28.738003 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Domain-Id: None Aug 31 12:23:28.738003 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Domain-Name: None Aug 31 12:23:28.738003 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Identity-Status: Confirmed Aug 31 12:23:28.738003 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Is-Admin-Project: True Aug 31 12:23:28.738003 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 12:23:28.738003 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Project-Domain-Id: default Aug 31 12:23:28.738003 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Project-Domain-Name: Default Aug 31 12:23:28.738003 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Project-Id: 088123e0cad144f3a713fb6c4c75d880 Aug 31 12:23:28.738003 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Project-Name: admin Aug 31 12:23:28.738003 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Role: reader,member,admin Aug 31 12:23:28.738003 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Roles: reader,member,admin Aug 31 12:23:28.739616 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/088123e0cad144f3a713fb6c4c75d880"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_088123e0cad144f3a713fb6c4c75d880", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/088123e0cad144f3a713fb6c4c75d880"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/088123e0cad144f3a713fb6c4c75d880"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:23:28.739616 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Tenant: admin Aug 31 12:23:28.739616 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Tenant-Id: 088123e0cad144f3a713fb6c4c75d880 Aug 31 12:23:28.739616 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-Tenant-Name: admin Aug 31 12:23:28.739616 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-User: admin Aug 31 12:23:28.739616 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-User-Domain-Id: default Aug 31 12:23:28.739616 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-User-Domain-Name: Default Aug 31 12:23:28.739616 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-User-Id: ba867dda5cc7471abb8f3da6ca94b58a Aug 31 12:23:28.739616 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: X-User-Name: admin Aug 31 12:23:28.739616 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: method: > Aug 31 12:23:28.739616 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: exception: Flavor 451 could not be found. Aug 31 12:23:28.739616 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: action_args: {'id': '451'} Aug 31 12:23:28.739616 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:23:28.739616 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:23:28.740668 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 12:23:28.740668 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 12:23:28.740668 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 12:23:28.740668 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 12:23:28.740668 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 12:23:28.740668 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 12:23:28.740668 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 12:23:28.740668 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 12:23:28.740668 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 12:23:28.740668 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:23:28.740668 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 12:23:28.740668 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 12:23:28.740668 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 12:23:28.740668 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi Aug 31 12:23:28.740668 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:23:28.740668 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi Aug 31 12:23:28.740668 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:23:28.740668 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:23:28.740668 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:23:28.741957 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:23:28.741957 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:23:28.741957 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:23:28.741957 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:23:28.741957 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 12:23:28.741957 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:23:28.741957 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 12:23:28.741957 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi Aug 31 12:23:28.741957 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:23:28.741957 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi Aug 31 12:23:28.741957 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:23:28.741957 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:23:28.741957 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:23:28.741957 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:23:28.741957 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:23:28.741957 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 12:23:28.741957 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: ERROR nova.api.openstack.wsgi Aug 31 12:23:28.741957 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-eb01d7d3-9554-4167-81c1-c3b87a027c7a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:23:28.743240 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-eb01d7d3-9554-4167-81c1-c3b87a027c7a admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.433355 Aug 31 12:23:28.743240 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 24/49] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Aug 31 12:23:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 434 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 12:23:28.749270 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-6dbf806c-7fcb-4eb4-b839-6f031ea0123c admin admin] Calling method '>' {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:28.764592 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-6dbf806c-7fcb-4eb4-b839-6f031ea0123c admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018770 Aug 31 12:23:28.765191 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 26/50] 10.222.0.79 () {60 vars in 1210 bytes} [Wed Aug 31 12:23:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:23:28.776269 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-cb49814c-f39c-498c-b730-310dddd37285 admin admin] Calling method '>' {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:28.792506 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-cb49814c-f39c-498c-b730-310dddd37285 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019755 Aug 31 12:23:28.793061 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 25/51] 10.222.0.79 () {60 vars in 1210 bytes} [Wed Aug 31 12:23:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:23:28.803573 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-9824f94a-468c-4a8a-982b-cbedb168b9d3 admin admin] Calling method '>' {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:28.809020 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.wsgi [None req-9824f94a-468c-4a8a-982b-cbedb168b9d3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 12:23:28.810532 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-9824f94a-468c-4a8a-982b-cbedb168b9d3 admin admin] Request method failure captured: Aug 31 12:23:28.810532 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 12:23:28.810532 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: Accept: application/json Aug 31 12:23:28.810532 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: Accept-Encoding: gzip, deflate Aug 31 12:23:28.810532 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: Connection: keep-alive Aug 31 12:23:28.810532 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: Content-Length: 0 Aug 31 12:23:28.810532 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: Host: 10.222.0.79 Aug 31 12:23:28.810532 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: Openstack-Api-Version: compute 2.90 Aug 31 12:23:28.810532 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: Openstack-System-Scope: None Aug 31 12:23:28.810532 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: User-Agent: python-novaclient Aug 31 12:23:28.810532 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Auth-Token: gAAAAABjD1LAPfCcOYBvPaL-ZaBpNt7a3yqOfrCMXl2RC21Q8Jam-GCY3J3LfKi_ro_Fa-7xYpR53rVSdEuJNLl8A5BvVo4WtINtlEnQDNxawcdDwbquCBO5fvcM22WrFoEM1bpMe9TZJc6rSeL4oRhEjWBuhRzRTvB1YZQVpE6Q_DTxPqk-Hms Aug 31 12:23:28.810532 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Domain-Id: None Aug 31 12:23:28.810532 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Domain-Name: None Aug 31 12:23:28.810532 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Identity-Status: Confirmed Aug 31 12:23:28.810532 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Is-Admin-Project: True Aug 31 12:23:28.810532 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 12:23:28.810532 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Project-Domain-Id: default Aug 31 12:23:28.810532 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Project-Domain-Name: Default Aug 31 12:23:28.810532 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Project-Id: 088123e0cad144f3a713fb6c4c75d880 Aug 31 12:23:28.810532 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Project-Name: admin Aug 31 12:23:28.810532 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Role: reader,member,admin Aug 31 12:23:28.810532 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Roles: reader,member,admin Aug 31 12:23:28.812411 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/088123e0cad144f3a713fb6c4c75d880"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_088123e0cad144f3a713fb6c4c75d880", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/088123e0cad144f3a713fb6c4c75d880"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/088123e0cad144f3a713fb6c4c75d880"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:23:28.812411 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Tenant: admin Aug 31 12:23:28.812411 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Tenant-Id: 088123e0cad144f3a713fb6c4c75d880 Aug 31 12:23:28.812411 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-Tenant-Name: admin Aug 31 12:23:28.812411 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-User: admin Aug 31 12:23:28.812411 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-User-Domain-Id: default Aug 31 12:23:28.812411 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-User-Domain-Name: Default Aug 31 12:23:28.812411 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-User-Id: ba867dda5cc7471abb8f3da6ca94b58a Aug 31 12:23:28.812411 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: X-User-Name: admin Aug 31 12:23:28.812411 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: method: > Aug 31 12:23:28.812411 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: exception: Flavor 451 could not be found. Aug 31 12:23:28.812411 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: action_args: {'id': '451'} Aug 31 12:23:28.812411 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:23:28.812411 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:23:28.813357 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 12:23:28.813357 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 12:23:28.813357 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 12:23:28.813357 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 12:23:28.813357 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 12:23:28.813357 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 12:23:28.813357 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 12:23:28.813357 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 12:23:28.813357 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 12:23:28.813357 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:23:28.813357 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 12:23:28.813357 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 12:23:28.813357 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 12:23:28.813357 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi Aug 31 12:23:28.813357 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:23:28.813357 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi Aug 31 12:23:28.813357 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:23:28.813357 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:23:28.813357 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:23:28.814606 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:23:28.814606 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:23:28.814606 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:23:28.814606 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:23:28.814606 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 12:23:28.814606 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:23:28.814606 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 12:23:28.814606 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi Aug 31 12:23:28.814606 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:23:28.814606 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi Aug 31 12:23:28.814606 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:23:28.814606 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:23:28.814606 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:23:28.814606 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:23:28.814606 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:23:28.814606 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 12:23:28.814606 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: ERROR nova.api.openstack.wsgi Aug 31 12:23:28.814606 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-9824f94a-468c-4a8a-982b-cbedb168b9d3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:23:28.816455 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-9824f94a-468c-4a8a-982b-cbedb168b9d3 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012770 Aug 31 12:23:28.816455 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 27/52] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Aug 31 12:23:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 12:23:29.804547 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-cb49814c-f39c-498c-b730-310dddd37285 admin admin] Calling method '>' {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:29.805572 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-cb49814c-f39c-498c-b730-310dddd37285 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 31 12:23:29.805967 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 26/53] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Aug 31 12:23:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:30.352765 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-333b8e4b-e495-42bf-8d5c-5331add071f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:23:30.373089 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-333b8e4b-e495-42bf-8d5c-5331add071f3 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.430105 Aug 31 12:23:30.373645 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 28/54] 10.222.0.79 () {64 vars in 1235 bytes} [Wed Aug 31 12:23:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:31.364363 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-cb49814c-f39c-498c-b730-310dddd37285 admin admin] Calling method '>' {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:31.365367 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-cb49814c-f39c-498c-b730-310dddd37285 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 31 12:23:31.365763 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 27/55] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Aug 31 12:23:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:23:31.923185 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-5cfbdf54-bcc3-46a0-9792-aad554944507 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:23:31.943848 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-5cfbdf54-bcc3-46a0-9792-aad554944507 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.439154 Aug 31 12:23:31.944401 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 29/56] 10.222.0.79 () {64 vars in 1235 bytes} [Wed Aug 31 12:23:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:23:32.939618 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-cb49814c-f39c-498c-b730-310dddd37285 admin admin] Calling method '>' {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:32.940587 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-cb49814c-f39c-498c-b730-310dddd37285 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 31 12:23:32.940989 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 28/57] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Aug 31 12:23:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:33.479306 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-ff2a7bfc-ae15-4192-97f1-60b28b78441e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:23:33.500390 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-ff2a7bfc-ae15-4192-97f1-60b28b78441e admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.419166 Aug 31 12:23:33.500934 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 30/58] 10.222.0.79 () {64 vars in 1235 bytes} [Wed Aug 31 12:23:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:34.498686 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-cb49814c-f39c-498c-b730-310dddd37285 admin admin] Calling method '>' {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:34.499823 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-cb49814c-f39c-498c-b730-310dddd37285 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 31 12:23:34.500211 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 29/59] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Aug 31 12:23:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:35.090752 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-1aa977ca-f047-4c62-bf9a-96c00c548121 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:23:35.111718 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-1aa977ca-f047-4c62-bf9a-96c00c548121 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.470798 Aug 31 12:23:35.113195 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 31/60] 10.222.0.79 () {64 vars in 1235 bytes} [Wed Aug 31 12:23:34 2022] POST /compute/v2.1/flavors => generated 409 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:36.102985 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-cb49814c-f39c-498c-b730-310dddd37285 admin admin] Calling method '>' {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:36.103998 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-cb49814c-f39c-498c-b730-310dddd37285 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 31 12:23:36.104397 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 30/61] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Aug 31 12:23:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:36.651164 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-13151829-f4bb-4670-ba63-8d199e36ed7c admin admin] Calling method '>' {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:36.671775 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-13151829-f4bb-4670-ba63-8d199e36ed7c admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.428432 Aug 31 12:23:36.672310 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 32/62] 10.222.0.79 () {60 vars in 1202 bytes} [Wed Aug 31 12:23:36 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:24:32.028395 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-cb49814c-f39c-498c-b730-310dddd37285 admin admin] Calling method '>' {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:32.029425 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-cb49814c-f39c-498c-b730-310dddd37285 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 31 12:24:32.029833 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 31/63] 10.222.0.79 () {54 vars in 931 bytes} [Wed Aug 31 12:24:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:32.041256 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG dbcounter [-] [105526] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:32.429216 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-db639d2c-e0d1-45b1-8adc-f4548fa166ae admin admin] Calling method '>' {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:32.449778 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-db639d2c-e0d1-45b1-8adc-f4548fa166ae admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.413042 Aug 31 12:24:32.450333 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 33/64] 10.222.0.79 () {60 vars in 1292 bytes} [Wed Aug 31 12:24:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:24:32.471073 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG dbcounter [-] [105527] Writing DB stats nova_api:SELECT=14 {{(pid=105527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:32.475913 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-11707b35-4b0b-4e7f-aa6a-99989f3536db admin admin] Calling method '>' {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:32.483739 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-11707b35-4b0b-4e7f-aa6a-99989f3536db admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014104 Aug 31 12:24:32.484288 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 32/65] 10.222.0.79 () {60 vars in 1283 bytes} [Wed Aug 31 12:24:32 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:24:32.496375 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-8ba8af0f-9d1d-4522-b460-70257b746f7c admin admin] Calling method '>' {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:32.505466 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-8ba8af0f-9d1d-4522-b460-70257b746f7c admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012653 Aug 31 12:24:32.506023 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 34/66] 10.222.0.79 () {60 vars in 1286 bytes} [Wed Aug 31 12:24:32 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:24:32.518914 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-98a620ab-00c0-4c18-a591-36798e292a3c admin admin] Calling method '>' {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:32.526745 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-98a620ab-00c0-4c18-a591-36798e292a3c admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011674 Aug 31 12:24:32.527359 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 33/67] 10.222.0.79 () {60 vars in 1286 bytes} [Wed Aug 31 12:24:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:24:32.540033 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-18af98d4-cc6d-4dec-801f-c4fd0600fe17 admin admin] Calling method '>' {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:32.547899 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-18af98d4-cc6d-4dec-801f-c4fd0600fe17 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011448 Aug 31 12:24:32.548443 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 35/68] 10.222.0.79 () {60 vars in 1283 bytes} [Wed Aug 31 12:24:32 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:27:30.950135 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-98a620ab-00c0-4c18-a591-36798e292a3c admin admin] Calling method '>' {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:30.951175 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-98a620ab-00c0-4c18-a591-36798e292a3c admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 31 12:27:30.951566 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 34/69] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Aug 31 12:27:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:31.090781 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG dbcounter [-] [105526] Writing DB stats nova_api:SELECT=6 {{(pid=105526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:27:31.251851 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-fd979dca-7407-4c76-a65f-fd900fb125bc admin admin] Calling method '>' {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:31.255460 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-fd979dca-7407-4c76-a65f-fd900fb125bc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:31.255964 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-fd979dca-7407-4c76-a65f-fd900fb125bc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:31.256394 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-fd979dca-7407-4c76-a65f-fd900fb125bc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:31.257115 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-fd979dca-7407-4c76-a65f-fd900fb125bc admin admin] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:31.257567 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-fd979dca-7407-4c76-a65f-fd900fb125bc admin admin] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:31.257983 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-fd979dca-7407-4c76-a65f-fd900fb125bc admin admin] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:31.294573 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-fd979dca-7407-4c76-a65f-fd900fb125bc admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.205154 Aug 31 12:27:31.295174 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 36/70] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Aug 31 12:27:31 2022] GET /compute/v2.1/os-services => generated 791 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:32.162922 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-98a620ab-00c0-4c18-a591-36798e292a3c admin admin] Calling method '>' {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:32.163924 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-98a620ab-00c0-4c18-a591-36798e292a3c admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 31 12:27:32.164313 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 35/71] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Aug 31 12:27:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:32.358110 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-529bc18a-8e5c-4dcc-8366-64ff9329d0f6 admin admin] Calling method '>' {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:32.361550 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-529bc18a-8e5c-4dcc-8366-64ff9329d0f6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:32.362011 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-529bc18a-8e5c-4dcc-8366-64ff9329d0f6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:32.362534 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-529bc18a-8e5c-4dcc-8366-64ff9329d0f6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:32.363368 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-529bc18a-8e5c-4dcc-8366-64ff9329d0f6 admin admin] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:32.363821 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-529bc18a-8e5c-4dcc-8366-64ff9329d0f6 admin admin] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:32.364236 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-529bc18a-8e5c-4dcc-8366-64ff9329d0f6 admin admin] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:32.383190 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-529bc18a-8e5c-4dcc-8366-64ff9329d0f6 admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077891 Aug 31 12:27:32.383755 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 37/72] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Aug 31 12:27:32 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:27:43.635266 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-98a620ab-00c0-4c18-a591-36798e292a3c admin admin] Calling method '>' {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:43.636329 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-98a620ab-00c0-4c18-a591-36798e292a3c admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Aug 31 12:27:43.636777 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 36/73] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Aug 31 12:27:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:27:43.783759 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG dbcounter [-] [105526] Writing DB stats nova_cell0:SELECT=4 {{(pid=105526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:27:43.784487 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG dbcounter [-] [105526] Writing DB stats nova_cell1:SELECT=4 {{(pid=105526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:27:43.785088 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG dbcounter [-] [105526] Writing DB stats nova_api:SELECT=8 {{(pid=105526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:27:43.835847 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-bc002c99-3606-447f-813f-6a6dd5b6a100 admin admin] Calling method '>' {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:43.839571 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-bc002c99-3606-447f-813f-6a6dd5b6a100 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:43.840044 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-bc002c99-3606-447f-813f-6a6dd5b6a100 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:43.840471 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-bc002c99-3606-447f-813f-6a6dd5b6a100 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:43.841210 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-bc002c99-3606-447f-813f-6a6dd5b6a100 admin admin] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:43.841649 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-bc002c99-3606-447f-813f-6a6dd5b6a100 admin admin] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:43.842060 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-bc002c99-3606-447f-813f-6a6dd5b6a100 admin admin] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:43.868011 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-bc002c99-3606-447f-813f-6a6dd5b6a100 admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088915 Aug 31 12:27:43.868554 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 38/74] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Aug 31 12:27:43 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:27:44.700852 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: DEBUG nova.api.openstack.wsgi [None req-98a620ab-00c0-4c18-a591-36798e292a3c admin admin] Calling method '>' {{(pid=105527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:44.701796 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: INFO nova.api.openstack.requestlog [None req-98a620ab-00c0-4c18-a591-36798e292a3c admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001911 Aug 31 12:27:44.702195 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: [pid: 105527|app: 0|req: 37/75] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Aug 31 12:27:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:44.895953 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG nova.api.openstack.wsgi [None req-6d040c18-434e-488e-b696-135b3afc230a admin admin] Calling method '>' {{(pid=105526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:44.899390 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-6d040c18-434e-488e-b696-135b3afc230a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:44.899866 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-6d040c18-434e-488e-b696-135b3afc230a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:44.900294 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-6d040c18-434e-488e-b696-135b3afc230a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:44.901034 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-6d040c18-434e-488e-b696-135b3afc230a admin admin] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:44.901485 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-6d040c18-434e-488e-b696-135b3afc230a admin admin] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:44.901914 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: DEBUG oslo_concurrency.lockutils [None req-6d040c18-434e-488e-b696-135b3afc230a admin admin] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:44.924195 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: INFO nova.api.openstack.requestlog [None req-6d040c18-434e-488e-b696-135b3afc230a admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080588 Aug 31 12:27:44.924746 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: [pid: 105526|app: 0|req: 39/76] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Aug 31 12:27:44 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:28:43.266704 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: Wed Aug 31 12:28:43 2022 - graceful shutdown triggered... Aug 31 12:28:43.267267 dv-cinder-855288-4-iscsi devstack@n-api.service[105527]: Gracefully killing worker 2 (pid: 105527)... Aug 31 12:28:43.267645 dv-cinder-855288-4-iscsi devstack@n-api.service[105526]: Gracefully killing worker 1 (pid: 105526)... Aug 31 12:28:43.270487 dv-cinder-855288-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 31 12:28:44.267546 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: worker 1 buried after 1 seconds Aug 31 12:28:44.268104 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: worker 2 buried after 1 seconds Aug 31 12:28:44.268104 dv-cinder-855288-4-iscsi devstack@n-api.service[105525]: goodbye to uWSGI. Aug 31 12:28:44.269163 dv-cinder-855288-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 31 12:28:44.269730 dv-cinder-855288-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 31 12:28:44.272618 dv-cinder-855288-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 12:28:44.282287 dv-cinder-855288-4-iscsi devstack@n-api.service[120735]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 12:28:44.284997 dv-cinder-855288-4-iscsi devstack@n-api.service[120735]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 12:28:44 2022] *** Aug 31 12:28:44.285173 dv-cinder-855288-4-iscsi devstack@n-api.service[120735]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 12:28:44.285173 dv-cinder-855288-4-iscsi devstack@n-api.service[120735]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 12:28:44.285173 dv-cinder-855288-4-iscsi devstack@n-api.service[120735]: nodename: dv-cinder-855288-4-iscsi Aug 31 12:28:44.285173 dv-cinder-855288-4-iscsi devstack@n-api.service[120735]: machine: x86_64 Aug 31 12:28:44.285173 dv-cinder-855288-4-iscsi devstack@n-api.service[120735]: clock source: unix Aug 31 12:28:44.285173 dv-cinder-855288-4-iscsi devstack@n-api.service[120735]: pcre jit disabled Aug 31 12:28:44.285173 dv-cinder-855288-4-iscsi devstack@n-api.service[120735]: detected number of CPU cores: 4 Aug 31 12:28:44.285173 dv-cinder-855288-4-iscsi devstack@n-api.service[120735]: current working directory: / Aug 31 12:28:44.285173 dv-cinder-855288-4-iscsi devstack@n-api.service[120735]: detected binary path: /usr/bin/uwsgi-core Aug 31 12:28:44.285173 dv-cinder-855288-4-iscsi devstack@n-api.service[120735]: your processes number limit is 47680 Aug 31 12:28:44.285826 dv-cinder-855288-4-iscsi devstack@n-api.service[120735]: your memory page size is 4096 bytes Aug 31 12:28:44.285826 dv-cinder-855288-4-iscsi devstack@n-api.service[120735]: detected max file descriptor number: 2048 Aug 31 12:28:44.285826 dv-cinder-855288-4-iscsi devstack@n-api.service[120735]: lock engine: pthread robust mutexes Aug 31 12:28:44.285826 dv-cinder-855288-4-iscsi devstack@n-api.service[120735]: thunder lock: enabled Aug 31 12:28:44.285826 dv-cinder-855288-4-iscsi devstack@n-api.service[120735]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 12:28:44.285826 dv-cinder-855288-4-iscsi devstack@n-api.service[120735]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 12:28:44.326687 dv-cinder-855288-4-iscsi devstack@n-api.service[120735]: Python main interpreter initialized at 0x556fc25c19c0 Aug 31 12:28:44.326687 dv-cinder-855288-4-iscsi devstack@n-api.service[120735]: python threads support enabled Aug 31 12:28:44.326687 dv-cinder-855288-4-iscsi devstack@n-api.service[120735]: your server socket listen backlog is limited to 100 connections Aug 31 12:28:44.326687 dv-cinder-855288-4-iscsi devstack@n-api.service[120735]: your mercy for graceful operations on workers is 90 seconds Aug 31 12:28:44.327129 dv-cinder-855288-4-iscsi devstack@n-api.service[120735]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 12:28:44.327129 dv-cinder-855288-4-iscsi devstack@n-api.service[120735]: *** Operational MODE: preforking *** Aug 31 12:28:44.327494 dv-cinder-855288-4-iscsi devstack@n-api.service[120735]: *** uWSGI is running in multiple interpreter mode *** Aug 31 12:28:44.327494 dv-cinder-855288-4-iscsi devstack@n-api.service[120735]: spawned uWSGI master process (pid: 120735) Aug 31 12:28:44.327628 dv-cinder-855288-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 12:28:44.328201 dv-cinder-855288-4-iscsi devstack@n-api.service[120735]: spawned uWSGI worker 1 (pid: 120749, cores: 1) Aug 31 12:28:44.328544 dv-cinder-855288-4-iscsi devstack@n-api.service[120735]: spawned uWSGI worker 2 (pid: 120750, cores: 1) Aug 31 12:28:44.328856 dv-cinder-855288-4-iscsi devstack@n-api.service[120735]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 12:28:44.991580 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 12:28:44.992211 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 12:28:46.151341 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:28:46.151341 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: from cryptography.utils import int_from_bytes Aug 31 12:28:46.151951 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:28:46.151951 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: from cryptography.utils import int_from_bytes Aug 31 12:28:46.158301 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:28:46.158301 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: from cryptography.utils import int_from_bytes Aug 31 12:28:46.158796 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:28:46.158796 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: from cryptography.utils import int_from_bytes Aug 31 12:28:48.594146 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 12:28:48.594940 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 12:28:48.594940 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 12:28:48.595309 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 12:28:48.595566 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 12:28:48.595958 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.596291 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.596614 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.596936 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.597407 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.597723 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.598050 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 12:28:48.598446 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.598541 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 12:28:48.598635 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.598726 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.598835 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 12:28:48.598967 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.599226 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 12:28:48.599328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.599487 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 12:28:48.599588 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855288-4-iscsi {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.599879 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.599981 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.600196 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.600305 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.600512 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.600606 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.600839 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.601002 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.601150 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.601310 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.601491 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.601650 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.601796 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.601933 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.602257 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.602667 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.602883 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.603896 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.604058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.604212 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.604362 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.604516 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.604661 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855288-4-iscsi {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.604827 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.604969 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.605117 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.605259 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.605430 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.605582 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.605735 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.606424 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.606655 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.606872 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.607038 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.607181 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.607340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.607494 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.607641 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855288-4-iscsi {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.607641 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.607641 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.608115 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.608281 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.608424 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.608424 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.608698 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.608857 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.609009 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.609009 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.609323 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.609466 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.609615 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.609757 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.609904 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.610052 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.610194 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.610194 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.610691 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.610691 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.611361 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.611361 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.611664 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.611664 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.612751 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855288-4-iscsi {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.612900 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.613076 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.613222 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.613374 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.613527 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.613671 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.613811 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.613811 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.613811 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.613811 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.614384 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.614528 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.614677 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.614953 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.615132 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.615296 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.615521 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.615694 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.615694 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.616012 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.618876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.619000 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.619086 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.619164 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.619238 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.619311 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.619393 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.619484 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.619558 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.619558 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.619696 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.619774 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.619857 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.619931 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.620003 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.620080 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.620154 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.620225 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.620309 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.620391 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.620464 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.620543 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.620622 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.620700 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.620784 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.620876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.620953 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.621025 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.621096 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.621166 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.621247 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.621247 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.621518 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.622152 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.622266 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.622413 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.622501 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.622582 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.622655 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.622726 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.622798 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.622926 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.623031 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.623116 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.623208 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.623283 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.623364 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.623364 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.623364 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.623571 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.623652 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.623730 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.623867 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.623969 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.624738 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.624905 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.625064 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.625212 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.625369 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.625528 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.625684 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.625831 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.625986 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.626142 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.626298 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.626452 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.626600 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.626769 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.626957 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.626957 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.627256 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.627256 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.627546 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.627701 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.627848 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.627848 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.628164 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.628311 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.628464 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.628611 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.628809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.628977 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.629125 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.629270 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.629422 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.629576 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.629724 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.629879 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.630042 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.630195 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.630348 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.631401 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.631579 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.631743 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.631900 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.632047 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.632233 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.632388 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.632549 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.632706 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.632859 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.633027 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.633181 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.633334 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.633510 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.633667 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.634388 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.634567 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.634723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.634948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.635106 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.635264 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.635410 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.635565 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.635730 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.635883 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.636029 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.636175 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.636328 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.636488 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.636648 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.636803 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.636949 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.637157 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.637321 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.637469 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.637614 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.637842 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.638008 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.638164 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.638320 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.638466 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.638619 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.638776 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.638995 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.639147 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.639304 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.639450 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.639604 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.639761 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.639956 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.640116 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.640352 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.640512 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.640512 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.640812 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.640995 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.641167 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.641625 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.641791 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.641940 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.642130 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.642298 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.642461 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.642626 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.642778 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.643012 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.643207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.643360 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.643513 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.643658 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.643814 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.643973 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.644129 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.644282 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.644446 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.644593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.644746 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.644901 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.645053 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.645204 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.645350 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.645502 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.645647 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.645806 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.645960 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.646106 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.646278 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.646425 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.646583 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.646735 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.646899 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.647064 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.647217 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.647371 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.647526 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.647673 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.647833 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.647991 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.648145 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.648310 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.648505 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.648653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.648806 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.648953 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.649156 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.649310 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.649471 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.649618 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.649772 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:28:48.649918 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.650063 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.650222 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.650385 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.650532 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.650684 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.650837 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.651027 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.651194 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.651354 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.651821 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.651996 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.652145 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.652299 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.652457 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.652758 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.652917 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.653064 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.653210 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.653355 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.653501 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.653662 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.653809 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.653956 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.654110 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.654265 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.654419 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.654578 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.654743 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.654922 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.655076 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.655076 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.655378 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.655682 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.655882 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.656046 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.656247 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.656446 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.656608 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.656764 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.656915 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.657081 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.657227 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.657383 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.657383 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.657383 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.657813 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.657959 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.658104 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.658249 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.658403 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.658548 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.658692 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.658836 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.659026 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.659241 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.659389 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.659545 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.659692 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.659843 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.659989 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.660148 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.660295 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.660447 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.660593 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.660746 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.660910 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.661069 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.661215 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.661372 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.661525 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.661995 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.662158 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.662319 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.662512 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.662663 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.662823 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.662995 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.663161 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.663324 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.663324 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.663618 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.663765 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.663916 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.664071 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.664224 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.664378 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.664529 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.664674 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.664818 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.664972 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.665157 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.665349 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.665528 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.665701 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.665849 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.666008 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.666154 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.666300 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.666453 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.666607 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.666766 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.666933 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.667096 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.667242 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.667405 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.667560 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.667726 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.667882 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.668036 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.668182 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.668889 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.669039 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.669243 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.669404 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.669551 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.669705 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.669863 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.670016 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.670171 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.670324 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.670469 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.670622 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.670775 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.671009 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.671176 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.671333 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.671479 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.671623 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.671794 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.672327 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.672518 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.672671 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.672819 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.672965 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.673110 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.673269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.673424 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.673580 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.673733 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.673881 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.674034 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.674195 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.674195 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.674491 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.674639 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.674784 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.674956 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.675123 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.675278 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.675431 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.675576 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.675721 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.675876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.676039 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.676288 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.676475 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.676626 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.676626 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.676918 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.677065 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.677209 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.677209 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.677499 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.677499 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.677783 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.677783 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.678061 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.678227 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.678373 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.678527 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.678680 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.678824 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.678993 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.679141 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.679346 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.679512 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.679659 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.679659 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.679949 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.680096 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.680260 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.680415 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.680559 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.680710 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.680856 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.681009 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.681155 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.681312 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.681458 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.681602 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.681753 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.681753 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.682426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.682609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.682768 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.683040 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.683194 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.683413 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.683653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.683803 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.684095 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.684795 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.684965 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.685120 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.685277 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.685424 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.685582 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.685824 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.685980 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.686133 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.686296 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.686451 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.686606 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.686759 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.686934 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.687095 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.687256 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.687403 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.687547 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.687711 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.687857 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.688010 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.688156 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.688156 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.688512 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.688696 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.688842 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.688995 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.689141 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.689286 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.689476 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.689645 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.689792 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.689946 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.690099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.690245 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.690398 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.690552 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.690552 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.690835 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.691008 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.691008 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.691294 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.691438 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.691605 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.691762 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.691914 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.692059 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.692469 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.692715 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.692882 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.693031 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.693176 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.693328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.693473 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.693617 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.693777 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.693935 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.694080 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.694224 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.694374 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.694519 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.694677 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.694889 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.695062 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.695218 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.695364 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.695508 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.695666 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.695814 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.695969 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.696114 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.696258 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.696412 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.696564 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.696717 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.696863 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.697007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.697151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.697304 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.697449 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.697593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.697737 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.697893 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.698045 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.698207 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.698364 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.698510 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.698662 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.698836 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.699206 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.699373 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.699676 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.699843 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.699998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.700163 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.700320 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.700466 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.700610 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.700755 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.700907 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.701062 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.701217 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.701370 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.701516 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.701668 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.701668 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.701951 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.701951 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.702255 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.702255 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.703019 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.703186 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.703341 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.703496 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.703643 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.703788 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.703940 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.703940 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.704234 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.704387 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.704544 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.704544 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.704869 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.705015 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.705170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.705317 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.705461 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.705605 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.705756 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.705909 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.706067 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.706267 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.706267 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.706267 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.706690 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.706843 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.707025 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.707182 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.707329 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.707473 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.707624 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.707780 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.707926 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.707926 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.708215 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.708384 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.708537 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.708696 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.708843 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.708994 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.709140 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.709284 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.709430 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.709638 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.709789 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.709943 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.710099 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.710276 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.710493 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.710650 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.710797 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.710999 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.711162 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.711323 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.711478 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.711624 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.711777 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.711936 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.712092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.712238 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.712383 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.712565 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.712984 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.713258 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.713421 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.713575 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.713723 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.713875 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.714029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.714184 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.714330 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.714475 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.714619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.714773 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.715008 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.715226 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.715381 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.715534 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.715689 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.715835 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.715988 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.716153 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.716307 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.716453 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.716598 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.716743 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.716912 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.717068 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.717214 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.717366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.717512 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.717670 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.717904 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.718058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.718217 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.718372 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.718540 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.718540 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.718879 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.719063 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.719225 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.719385 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.719546 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.719747 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.719916 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.720079 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.720238 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.720392 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.720598 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.720806 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.720806 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.721129 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.721294 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.721455 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.721608 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.721773 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.721927 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.722087 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.722240 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.722405 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.722567 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.722567 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.722567 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.723420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.723591 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.723766 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.723920 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.724079 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.724240 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.724392 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.724623 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.724785 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.724946 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.725105 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.725259 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.725411 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.725577 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.725742 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.725893 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.726053 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.726214 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.726366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.726531 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.726685 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.726868 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.727041 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.727196 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.727356 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.727780 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.727934 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.728097 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.728261 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.728422 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.728588 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.728756 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.728907 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.729058 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.729217 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.729379 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.729541 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.729694 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.729902 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.730057 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.730219 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.730372 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.730537 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.730698 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.731472 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.731642 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.731803 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.731964 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.732126 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.732280 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.732432 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.732585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.732745 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.732919 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.732919 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.733636 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.733806 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.733961 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.734113 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.734281 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.734281 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.734587 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.734587 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.734895 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.735068 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.735247 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.735409 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.735569 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.735722 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.735881 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.736041 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.736207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.736367 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.736519 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.736670 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.736824 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.736988 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.737141 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.737317 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.737469 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.737630 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.737783 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.737992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.738175 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.738333 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.739308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.739483 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.739659 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.739893 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.740064 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.740227 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.740404 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.740567 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.740728 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.740896 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.741051 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.741211 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.741211 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.741499 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.741660 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.741820 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.741982 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.742141 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.742301 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.742470 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.742637 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.742797 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.742978 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.743132 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.743548 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.743825 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.743997 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.744152 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.744304 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.744455 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.744608 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.744767 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.744942 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.745096 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.745685 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.745866 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.746023 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.746196 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.746359 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.747493 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.747685 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.747854 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.748009 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.748175 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.748345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.748499 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.748660 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.748824 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.748986 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.749152 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.749314 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.749466 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.749618 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.749770 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.749982 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.750157 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.750321 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.750486 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.750646 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.750799 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.750990 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.751153 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.751307 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.751459 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.751611 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.751762 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.751969 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.752129 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.752291 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.752445 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.752661 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.752858 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.753027 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.753188 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.753341 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.753757 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.754027 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.754187 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.754350 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.754511 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.754673 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.754833 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.755053 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.755251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.755423 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.755585 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.755745 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.756573 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.756756 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.756931 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.757094 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.757256 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.757416 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.757569 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.757722 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.757899 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.758052 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.758204 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.758356 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.758580 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.758750 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.758996 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.759166 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.759275 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.759360 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.759443 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.759597 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.759597 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.759760 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.759760 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.759935 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.760075 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.760075 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.760242 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.760332 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.760450 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.760450 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.760600 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.760693 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.760775 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.760857 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.760932 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.761004 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.761076 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.761161 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.761161 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.761302 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.761383 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.761457 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.761529 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.761614 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.761689 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.761767 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.761849 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.761849 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.762059 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.762156 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.762241 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.762322 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.762397 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.762532 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.762532 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.762701 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.762784 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.762880 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.762961 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.762961 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.763108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.763185 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.763258 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.763331 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.763448 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.763543 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.763649 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.764044 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.764125 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.764207 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.764281 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.764362 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.764444 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.764526 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.764599 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.764672 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.764750 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.764833 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.764915 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.764996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.765071 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.765150 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.765224 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.765224 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.765224 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.765224 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.765488 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.765578 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.765673 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.765762 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.765762 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.765927 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.766016 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.766112 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.766209 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.766298 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.766391 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.766486 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.766486 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.766486 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.766733 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.766822 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.766938 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.767049 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.767150 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.767239 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.767326 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.767407 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.767489 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.767571 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.767660 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.767735 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.767815 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.767889 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.767970 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.768051 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.768134 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.768216 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.768291 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.768364 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.768436 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.768509 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.768595 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.768595 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.768752 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.768827 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.768908 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.768991 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.769066 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.769146 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.769221 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.769293 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.769366 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.769459 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.769535 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.769535 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.769672 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.769756 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.769831 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.769929 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.770011 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.770263 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.770353 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.770436 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.770523 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.770612 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.770688 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.770761 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.770832 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.771449 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.771594 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.771718 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.771832 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.771952 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.772066 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.772186 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.772383 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.772499 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.772613 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.772724 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.772843 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.772957 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.773094 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.773209 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.773321 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.773682 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.773876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.774302 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.774461 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.774461 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.774751 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.774941 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.775112 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.775279 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.775453 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.775616 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.775770 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.775930 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.776091 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.776266 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.776421 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.776634 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.776794 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.776999 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.777164 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.777328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.777481 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.777703 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.777874 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.778029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.778192 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.778353 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.778506 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.778660 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.778660 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.778660 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.779165 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.779328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.779483 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.779646 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.779799 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.779989 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.780910 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.781085 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.781345 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.781516 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.781672 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.781835 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.782008 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.782165 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.782325 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.782479 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.782651 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.782805 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.783051 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.783217 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.783370 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.783522 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.783674 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.783836 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.783998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.784424 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.784587 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.784800 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.784994 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.785180 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.785342 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.785496 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.785648 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.785801 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.785953 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.786115 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.786268 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.786430 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.786591 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.786843 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.787025 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.787195 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.787360 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.787522 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.787683 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.787844 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.788009 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.788163 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.788323 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.788486 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.788647 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.788812 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.788974 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.789129 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.789292 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.789445 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.789596 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.789756 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.789925 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.790078 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.790230 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.790383 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.790535 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.790697 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.791002 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.791171 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.791347 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.791583 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.791743 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.791910 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.792065 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.792065 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.792356 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.792518 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.792682 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.792850 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.793003 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.793155 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.793862 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.794034 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.794203 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.794610 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.794783 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.795052 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.795207 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.795361 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.795527 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.795682 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.795854 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.796009 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.796161 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.796332 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.796497 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.796659 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.796820 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.796820 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.796820 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.797269 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.797423 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.797585 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.797746 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.797907 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.798060 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.798220 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.798384 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.798537 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.798689 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.798865 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.799028 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.799195 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.799368 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.799530 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.799692 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.799845 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.799996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.800158 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.800330 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.800490 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.800652 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.800804 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.801030 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.801280 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.801448 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.801621 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.801856 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.802015 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.802189 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.802189 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.802489 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.802665 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.802820 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.802820 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.803190 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.803344 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.803497 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.803497 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.803809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.803976 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.804130 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.804281 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.804452 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.804845 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.805010 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.805243 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.805407 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.805570 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.805724 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.805885 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.806048 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.806215 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.806368 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.806530 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.806682 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.806682 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.807014 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.807182 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.807345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.807498 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.807657 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.807817 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.807980 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.808142 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.808296 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.808449 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.808613 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.808775 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.809564 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.809729 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.809892 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.810054 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.810391 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.810558 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.810719 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.811343 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.811622 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.811792 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.812043 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.812221 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.812397 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.812552 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.812705 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.812857 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.813010 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.813176 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.813339 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.813500 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.813654 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.813806 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.813958 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.813958 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.813958 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.814407 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.814567 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.814974 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.815158 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.815313 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.815467 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.815619 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.815786 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.815948 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.816728 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.816962 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.817171 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.817347 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.817503 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.817503 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.817793 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.817946 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.818108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.818273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.818427 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.818589 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.818742 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.818966 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.819127 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.819303 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.819457 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.819619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.819792 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.819948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.820108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.820270 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.820424 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.820578 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.820730 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.820890 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.821057 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.821267 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.821445 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.821620 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.821894 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.822072 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.822324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.822485 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.822637 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.822797 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.822986 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.823141 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.823304 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.823465 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.823619 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.823784 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.823937 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.824090 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.824257 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.824412 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.824638 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.824806 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.825356 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.825536 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.825699 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.825854 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.826013 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.826174 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.826339 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.826506 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.826660 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.826822 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.827026 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.827183 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.827344 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.827512 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.827667 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.827834 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.827996 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.828158 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.828559 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.828666 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.828756 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.828853 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.828950 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.829046 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.829148 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.829238 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.829325 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.829412 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.829499 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.829586 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.829681 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.829771 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.829889 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.830169 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.830169 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.830169 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.830579 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.830709 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.830825 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.830983 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.831086 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.831185 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.831378 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.831525 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.831667 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.831768 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.831883 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.832042 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.832148 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.832239 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.832344 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.832442 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.832537 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.832634 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.832731 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.832731 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.832731 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.832731 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.832731 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.833128 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.833225 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.833313 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.833399 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.833486 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.833587 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.833684 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.833775 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.833869 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.833964 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.834053 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.834149 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.834244 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.834339 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.834427 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.834514 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.834601 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.834762 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.834897 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.835001 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.835098 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.836044 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.836173 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.836274 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.836371 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.836371 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.836549 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.836638 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.836727 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.836811 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.836892 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.836988 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.837082 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.837082 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.837240 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.837336 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.837430 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.837525 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.837621 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.837716 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.837813 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.837901 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.837901 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.838075 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.838162 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.838263 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.838359 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.838503 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.838600 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.838689 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.838783 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.838907 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.839008 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.839097 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.839193 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.839282 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.839369 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.839466 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.839555 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.839650 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.839864 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.839974 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.840207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.840316 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.840533 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.841092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.841201 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.841315 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.841478 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.841624 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.841786 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.841921 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.842117 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.842260 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.842477 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.842575 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.842808 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.843044 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.843137 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.843223 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.843443 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.843548 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.843754 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.843857 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.844061 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.844170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.844371 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.844473 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.844679 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.844775 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.845018 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.845124 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.845362 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.845510 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.845690 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.845794 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.846019 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.846137 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.846340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.846435 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.846667 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.846770 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.847032 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.847134 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.847360 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.847490 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.847689 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.847782 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.848015 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.848123 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.848331 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.848440 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.848672 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.848798 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.849105 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.849214 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.849304 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.849402 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.849598 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.849702 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.849913 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.850027 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.850229 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.850346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.850541 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.850653 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.850899 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.851004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.851233 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.851331 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.851545 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.851703 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.851854 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.851951 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.852172 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.852266 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.852751 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.852866 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.853070 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.853176 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.853383 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.853478 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.853693 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.853788 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.854018 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.854120 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.854327 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.854481 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.854639 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.854736 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.854975 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.855075 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.855289 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.855394 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.855611 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.856781 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.856781 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.857010 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.857205 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.857205 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.857521 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.857600 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.857673 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.858229 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.858340 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.858426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.858501 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.858573 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.858644 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.859000 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.859100 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.859189 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.859262 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.859487 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.859605 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.859795 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.859901 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.860109 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.860207 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.860419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.860522 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.860764 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.860864 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.861093 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.861189 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.861481 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.861673 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.861812 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 12:28:48.861957 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.862060 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.862347 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.862666 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.863020 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.863350 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.863676 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.863996 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.864351 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.864665 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.864985 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.865300 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.865650 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.865937 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.866254 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.866640 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.866999 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.867320 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.867655 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.867982 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.868309 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.868638 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.868948 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.869289 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.869602 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.869920 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.870239 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.870556 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.870903 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.871218 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.872168 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.873116 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.873445 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.873778 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.874118 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.874465 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.874791 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.875229 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.875570 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.875930 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.876254 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.876613 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.876951 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.877273 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.877593 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.877905 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:28:48.878155 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 12:28:48.925259 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO dbcounter [None req-a0a1a4e5-eb28-4d8a-b53c-43d76f528a15 None None] Registered counter for database nova_api Aug 31 12:28:48.946790 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_db.sqlalchemy.engines [None req-a0a1a4e5-eb28-4d8a-b53c-43d76f528a15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120749) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:28:48.948776 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO dbcounter [None req-11597a82-14dd-48d4-bd55-67b5c0114f51 None None] Registered counter for database nova_api Aug 31 12:28:48.954003 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writer thread running {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:28:48.973047 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_db.sqlalchemy.engines [None req-11597a82-14dd-48d4-bd55-67b5c0114f51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120750) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:28:48.980373 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writer thread running {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:28:49.014206 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.context [None req-a0a1a4e5-eb28-4d8a-b53c-43d76f528a15 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a65646e1-71cc-4e16-b061-01c594ea7d86(cell1) {{(pid=120749) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 12:28:49.018256 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a0a1a4e5-eb28-4d8a-b53c-43d76f528a15 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:49.018740 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a0a1a4e5-eb28-4d8a-b53c-43d76f528a15 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:49.020366 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a0a1a4e5-eb28-4d8a-b53c-43d76f528a15 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:49.021092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a0a1a4e5-eb28-4d8a-b53c-43d76f528a15 None None] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:49.021571 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a0a1a4e5-eb28-4d8a-b53c-43d76f528a15 None None] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:49.023609 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a0a1a4e5-eb28-4d8a-b53c-43d76f528a15 None None] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:49.025608 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO dbcounter [None req-a0a1a4e5-eb28-4d8a-b53c-43d76f528a15 None None] Registered counter for database nova_cell0 Aug 31 12:28:49.030267 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO dbcounter [None req-a0a1a4e5-eb28-4d8a-b53c-43d76f528a15 None None] Registered counter for database nova_cell1 Aug 31 12:28:49.037777 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_db.sqlalchemy.engines [None req-a0a1a4e5-eb28-4d8a-b53c-43d76f528a15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120749) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:28:49.040166 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_db.sqlalchemy.engines [None req-a0a1a4e5-eb28-4d8a-b53c-43d76f528a15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120749) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:28:49.040926 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.context [None req-11597a82-14dd-48d4-bd55-67b5c0114f51 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a65646e1-71cc-4e16-b061-01c594ea7d86(cell1) {{(pid=120750) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 12:28:49.046276 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-11597a82-14dd-48d4-bd55-67b5c0114f51 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:49.046766 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-11597a82-14dd-48d4-bd55-67b5c0114f51 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:49.047984 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writer thread running {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:28:49.048381 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-11597a82-14dd-48d4-bd55-67b5c0114f51 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:49.049138 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-11597a82-14dd-48d4-bd55-67b5c0114f51 None None] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:49.049374 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writer thread running {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:28:49.049588 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-11597a82-14dd-48d4-bd55-67b5c0114f51 None None] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:49.051633 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-11597a82-14dd-48d4-bd55-67b5c0114f51 None None] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:49.053681 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO dbcounter [None req-11597a82-14dd-48d4-bd55-67b5c0114f51 None None] Registered counter for database nova_cell0 Aug 31 12:28:49.057869 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO dbcounter [None req-11597a82-14dd-48d4-bd55-67b5c0114f51 None None] Registered counter for database nova_cell1 Aug 31 12:28:49.066308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_db.sqlalchemy.engines [None req-11597a82-14dd-48d4-bd55-67b5c0114f51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120750) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:28:49.069687 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_db.sqlalchemy.engines [None req-11597a82-14dd-48d4-bd55-67b5c0114f51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120750) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:28:49.072685 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writer thread running {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:28:49.203069 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO dbcounter [None req-a0a1a4e5-eb28-4d8a-b53c-43d76f528a15 None None] Registered counter for database nova_cell0 Aug 31 12:28:49.209854 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_db.sqlalchemy.engines [None req-a0a1a4e5-eb28-4d8a-b53c-43d76f528a15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120749) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:28:49.214533 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writer thread running {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:28:49.226793 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writer thread running {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:28:49.237959 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO dbcounter [None req-11597a82-14dd-48d4-bd55-67b5c0114f51 None None] Registered counter for database nova_cell0 Aug 31 12:28:49.244855 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_db.sqlalchemy.engines [None req-11597a82-14dd-48d4-bd55-67b5c0114f51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120750) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:28:49.250938 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writer thread running {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:28:49.543905 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: WARNING keystonemiddleware.auth_token [None req-a0a1a4e5-eb28-4d8a-b53c-43d76f528a15 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 12:28:49.551198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: WARNING keystonemiddleware.auth_token [None req-a0a1a4e5-eb28-4d8a-b53c-43d76f528a15 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 12:28:49.603285 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: WARNING keystonemiddleware.auth_token [None req-11597a82-14dd-48d4-bd55-67b5c0114f51 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 12:28:49.611426 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: WARNING keystonemiddleware.auth_token [None req-11597a82-14dd-48d4-bd55-67b5c0114f51 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 12:28:49.898800 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: WARNING keystonemiddleware.auth_token [None req-a0a1a4e5-eb28-4d8a-b53c-43d76f528a15 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 12:28:49.904722 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: WARNING keystonemiddleware.auth_token [None req-a0a1a4e5-eb28-4d8a-b53c-43d76f528a15 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 12:28:49.910034 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556fc25c19c0 pid: 120749 (default app) Aug 31 12:28:49.967113 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: WARNING keystonemiddleware.auth_token [None req-11597a82-14dd-48d4-bd55-67b5c0114f51 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 12:28:49.973106 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: WARNING keystonemiddleware.auth_token [None req-11597a82-14dd-48d4-bd55-67b5c0114f51 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 12:28:49.978645 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556fc25c19c0 pid: 120750 (default app) Aug 31 12:29:29.738944 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_api:SELECT=3 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:29.740455 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=3 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:29.741380 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=3 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:29.742340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=3 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:30.516820 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_api:SELECT=3 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:30.517776 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=3 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:30.518701 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell0:SELECT=3 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:30.519722 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell0:SELECT=3 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:31.323151 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-8d001dc2-e9c4-43b6-9ba9-2c57e7beb189 tempest-VolumesNegativeTest-1906905764 tempest-VolumesNegativeTest-1906905764-project] Action: 'create', calling method: .version_select at 0x7f8d18145ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-480968243", "metadata": {"Type": "work"}}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:29:31.330022 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-8d001dc2-e9c4-43b6-9ba9-2c57e7beb189 tempest-VolumesNegativeTest-1906905764 tempest-VolumesNegativeTest-1906905764-project] Request method failure captured: Aug 31 12:29:31.330022 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 12:29:31.330022 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept: application/json Aug 31 12:29:31.330022 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept-Encoding: identity Aug 31 12:29:31.330022 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Connection: close Aug 31 12:29:31.330022 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Length: 121 Aug 31 12:29:31.330022 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Type: application/json Aug 31 12:29:31.330022 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Host: 10.222.0.79 Aug 31 12:29:31.330022 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Openstack-System-Scope: None Aug 31 12:29:31.330022 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: User-Agent: python-urllib3/1.26.12 Aug 31 12:29:31.330022 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Auth-Token: gAAAAABjD1QpgHDw3ijeEAXvcHo2Bz_4W4sWsZ8cvoURUwd_1svktA0GO-y24suaGiOjNdo1HcPCaXRudc1i7_SXKF19VAzrqWPzhk9N4hryaHan9iFHJHUuF1ea1k6M8rLKOWHDQ6uhl5bXLsHHSATA3WGRKmbeWjm3j55cuboovwZyPWjElzA Aug 31 12:29:31.330022 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Id: None Aug 31 12:29:31.330022 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Name: None Aug 31 12:29:31.330022 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Identity-Status: Confirmed Aug 31 12:29:31.330022 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Is-Admin-Project: True Aug 31 12:29:31.330022 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Id: default Aug 31 12:29:31.330022 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Name: Default Aug 31 12:29:31.330022 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Id: ca25ca2519ae4697b952d9451321980d Aug 31 12:29:31.330022 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Name: tempest-VolumesNegativeTest-1906905764 Aug 31 12:29:31.330022 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Role: reader,member Aug 31 12:29:31.330022 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Roles: reader,member Aug 31 12:29:31.331436 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ca25ca2519ae4697b952d9451321980d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ca25ca2519ae4697b952d9451321980d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca25ca2519ae4697b952d9451321980d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca25ca2519ae4697b952d9451321980d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:29:31.331436 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant: tempest-VolumesNegativeTest-1906905764 Aug 31 12:29:31.331436 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Id: ca25ca2519ae4697b952d9451321980d Aug 31 12:29:31.331436 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Name: tempest-VolumesNegativeTest-1906905764 Aug 31 12:29:31.331436 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User: tempest-VolumesNegativeTest-1906905764-project Aug 31 12:29:31.331436 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Id: default Aug 31 12:29:31.331436 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Name: Default Aug 31 12:29:31.331436 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Id: 5a3b11bf184943698c459d79f158400b Aug 31 12:29:31.331436 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Name: tempest-VolumesNegativeTest-1906905764-project Aug 31 12:29:31.331436 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Aug 31 12:29:31.331436 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-480968243", "metadata": {"Type": "work"}}} Aug 31 12:29:31.331436 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: method: Aug 31 12:29:31.331436 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 12:29:31.332269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-480968243', 'metadata': {'Type': 'work'}}}} Aug 31 12:29:31.332269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:29:31.332269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:31.332269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 12:29:31.332269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 12:29:31.332269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 12:29:31.332269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise error Aug 31 12:29:31.332269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 31 12:29:31.332269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:31.332269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 12:29:31.332269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 12:29:31.332269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:31.332269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 12:29:31.332269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi '#$%' Aug 31 12:29:31.332269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:31.332269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:29:31.332269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:31.332269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:31.332269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:29:31.332269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:29:31.332269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:29:31.332269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:29:31.333593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:29:31.333593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:29:31.333593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:29:31.333593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:29:31.333593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 12:29:31.333593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 12:29:31.333593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 12:29:31.333593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 12:29:31.333593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 12:29:31.333593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 12:29:31.333593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 12:29:31.333593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:31.333593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:29:31.333593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:31.333593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:31.333593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:29:31.333593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:29:31.333593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 12:29:31.333593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 12:29:31.334801 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 12:29:31.334801 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:31.334801 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-8d001dc2-e9c4-43b6-9ba9-2c57e7beb189 tempest-VolumesNegativeTest-1906905764 tempest-VolumesNegativeTest-1906905764-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:29:31.334801 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-8d001dc2-e9c4-43b6-9ba9-2c57e7beb189 tempest-VolumesNegativeTest-1906905764 tempest-VolumesNegativeTest-1906905764-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.607282 Aug 31 12:29:31.334801 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 1/1] 10.222.0.79 () {60 vars in 1156 bytes} [Wed Aug 31 12:29:29 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1609 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 12:29:31.350822 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-9f62c66b-dc2c-4206-9809-f4446aa221a2 tempest-VolumesNegativeTest-1906905764 tempest-VolumesNegativeTest-1906905764-project] Action: 'create', calling method: .version_select at 0x7f8d180969d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1975469547", "metadata": {"Type": "work"}}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:29:31.356716 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-9f62c66b-dc2c-4206-9809-f4446aa221a2 tempest-VolumesNegativeTest-1906905764 tempest-VolumesNegativeTest-1906905764-project] Request method failure captured: Aug 31 12:29:31.356716 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 12:29:31.356716 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept: application/json Aug 31 12:29:31.356716 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept-Encoding: identity Aug 31 12:29:31.356716 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Connection: close Aug 31 12:29:31.356716 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Length: 120 Aug 31 12:29:31.356716 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Type: application/json Aug 31 12:29:31.356716 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Host: 10.222.0.79 Aug 31 12:29:31.356716 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Openstack-System-Scope: None Aug 31 12:29:31.356716 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: User-Agent: python-urllib3/1.26.12 Aug 31 12:29:31.356716 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Auth-Token: gAAAAABjD1QpgHDw3ijeEAXvcHo2Bz_4W4sWsZ8cvoURUwd_1svktA0GO-y24suaGiOjNdo1HcPCaXRudc1i7_SXKF19VAzrqWPzhk9N4hryaHan9iFHJHUuF1ea1k6M8rLKOWHDQ6uhl5bXLsHHSATA3WGRKmbeWjm3j55cuboovwZyPWjElzA Aug 31 12:29:31.356716 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Id: None Aug 31 12:29:31.356716 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Name: None Aug 31 12:29:31.356716 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Identity-Status: Confirmed Aug 31 12:29:31.356716 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Is-Admin-Project: True Aug 31 12:29:31.356716 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Id: default Aug 31 12:29:31.356716 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Name: Default Aug 31 12:29:31.356716 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Id: ca25ca2519ae4697b952d9451321980d Aug 31 12:29:31.356716 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Name: tempest-VolumesNegativeTest-1906905764 Aug 31 12:29:31.356716 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Role: reader,member Aug 31 12:29:31.356716 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Roles: reader,member Aug 31 12:29:31.358133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ca25ca2519ae4697b952d9451321980d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ca25ca2519ae4697b952d9451321980d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca25ca2519ae4697b952d9451321980d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca25ca2519ae4697b952d9451321980d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:29:31.358133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant: tempest-VolumesNegativeTest-1906905764 Aug 31 12:29:31.358133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Id: ca25ca2519ae4697b952d9451321980d Aug 31 12:29:31.358133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Name: tempest-VolumesNegativeTest-1906905764 Aug 31 12:29:31.358133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User: tempest-VolumesNegativeTest-1906905764-project Aug 31 12:29:31.358133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Id: default Aug 31 12:29:31.358133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Name: Default Aug 31 12:29:31.358133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Id: 5a3b11bf184943698c459d79f158400b Aug 31 12:29:31.358133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Name: tempest-VolumesNegativeTest-1906905764-project Aug 31 12:29:31.358133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Aug 31 12:29:31.358133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1975469547", "metadata": {"Type": "work"}}} Aug 31 12:29:31.358133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: method: Aug 31 12:29:31.358133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 12:29:31.358948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1975469547', 'metadata': {'Type': 'work'}}}} Aug 31 12:29:31.358948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:29:31.358948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:31.358948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 12:29:31.358948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 12:29:31.358948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 12:29:31.358948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise error Aug 31 12:29:31.358948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 31 12:29:31.358948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:31.358948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 31 12:29:31.358948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 12:29:31.358948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:31.358948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 12:29:31.358948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi '0' Aug 31 12:29:31.358948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:31.358948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:29:31.358948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:31.358948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:31.358948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:29:31.358948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:29:31.358948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:29:31.358948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:29:31.360231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:29:31.360231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:29:31.360231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:29:31.360231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:29:31.360231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 12:29:31.360231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 12:29:31.360231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 12:29:31.360231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 12:29:31.360231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 12:29:31.360231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 12:29:31.360231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 12:29:31.360231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:31.360231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:29:31.360231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:31.360231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:31.360231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:29:31.360231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:29:31.360231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 12:29:31.360231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 12:29:31.361337 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 12:29:31.361337 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:31.363268 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-9f62c66b-dc2c-4206-9809-f4446aa221a2 tempest-VolumesNegativeTest-1906905764 tempest-VolumesNegativeTest-1906905764-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:29:31.364292 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-9f62c66b-dc2c-4206-9809-f4446aa221a2 tempest-VolumesNegativeTest-1906905764 tempest-VolumesNegativeTest-1906905764-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.019472 Aug 31 12:29:31.365343 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 2/2] 10.222.0.79 () {60 vars in 1156 bytes} [Wed Aug 31 12:29:31 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 12:29:31.375801 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-c7c7b669-d938-47fc-9918-61530e8bf658 tempest-VolumesNegativeTest-1906905764 tempest-VolumesNegativeTest-1906905764-project] Action: 'create', calling method: .version_select at 0x7f8d18011a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1635622409", "metadata": {"Type": "work"}}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:29:31.381273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-c7c7b669-d938-47fc-9918-61530e8bf658 tempest-VolumesNegativeTest-1906905764 tempest-VolumesNegativeTest-1906905764-project] Request method failure captured: Aug 31 12:29:31.381273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 12:29:31.381273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept: application/json Aug 31 12:29:31.381273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept-Encoding: identity Aug 31 12:29:31.381273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Connection: close Aug 31 12:29:31.381273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Length: 119 Aug 31 12:29:31.381273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Type: application/json Aug 31 12:29:31.381273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Host: 10.222.0.79 Aug 31 12:29:31.381273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Openstack-System-Scope: None Aug 31 12:29:31.381273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: User-Agent: python-urllib3/1.26.12 Aug 31 12:29:31.381273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Auth-Token: gAAAAABjD1QpgHDw3ijeEAXvcHo2Bz_4W4sWsZ8cvoURUwd_1svktA0GO-y24suaGiOjNdo1HcPCaXRudc1i7_SXKF19VAzrqWPzhk9N4hryaHan9iFHJHUuF1ea1k6M8rLKOWHDQ6uhl5bXLsHHSATA3WGRKmbeWjm3j55cuboovwZyPWjElzA Aug 31 12:29:31.381273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Id: None Aug 31 12:29:31.381273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Name: None Aug 31 12:29:31.381273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Identity-Status: Confirmed Aug 31 12:29:31.381273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Is-Admin-Project: True Aug 31 12:29:31.381273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Id: default Aug 31 12:29:31.381273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Name: Default Aug 31 12:29:31.381273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Id: ca25ca2519ae4697b952d9451321980d Aug 31 12:29:31.381273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Name: tempest-VolumesNegativeTest-1906905764 Aug 31 12:29:31.381273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Role: reader,member Aug 31 12:29:31.381273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Roles: reader,member Aug 31 12:29:31.382599 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ca25ca2519ae4697b952d9451321980d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ca25ca2519ae4697b952d9451321980d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca25ca2519ae4697b952d9451321980d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca25ca2519ae4697b952d9451321980d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:29:31.382599 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant: tempest-VolumesNegativeTest-1906905764 Aug 31 12:29:31.382599 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Id: ca25ca2519ae4697b952d9451321980d Aug 31 12:29:31.382599 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Name: tempest-VolumesNegativeTest-1906905764 Aug 31 12:29:31.382599 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User: tempest-VolumesNegativeTest-1906905764-project Aug 31 12:29:31.382599 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Id: default Aug 31 12:29:31.382599 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Name: Default Aug 31 12:29:31.382599 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Id: 5a3b11bf184943698c459d79f158400b Aug 31 12:29:31.382599 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Name: tempest-VolumesNegativeTest-1906905764-project Aug 31 12:29:31.382599 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Aug 31 12:29:31.382599 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1635622409", "metadata": {"Type": "work"}}} Aug 31 12:29:31.382599 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: method: Aug 31 12:29:31.382599 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 12:29:31.383462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1635622409', 'metadata': {'Type': 'work'}}}} Aug 31 12:29:31.383462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:29:31.383462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:31.383462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 12:29:31.383462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 12:29:31.383462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 12:29:31.383462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise error Aug 31 12:29:31.383462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 31 12:29:31.383462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:31.383462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 12:29:31.383462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 12:29:31.383462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:31.383462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 12:29:31.383462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi '' Aug 31 12:29:31.383462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:31.383462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:29:31.383462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:31.383462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:31.383462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:29:31.383462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:29:31.383462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:29:31.383462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:29:31.384747 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:29:31.384747 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:29:31.384747 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:29:31.384747 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:29:31.384747 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 12:29:31.384747 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 12:29:31.384747 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 12:29:31.384747 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 12:29:31.384747 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 12:29:31.384747 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 12:29:31.384747 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 12:29:31.384747 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:31.384747 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:29:31.384747 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:31.384747 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:31.384747 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:29:31.384747 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:29:31.384747 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 12:29:31.384747 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 12:29:31.385846 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 12:29:31.385846 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:31.387499 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-c7c7b669-d938-47fc-9918-61530e8bf658 tempest-VolumesNegativeTest-1906905764 tempest-VolumesNegativeTest-1906905764-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:29:31.388528 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-c7c7b669-d938-47fc-9918-61530e8bf658 tempest-VolumesNegativeTest-1906905764 tempest-VolumesNegativeTest-1906905764-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017627 Aug 31 12:29:31.389693 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 3/3] 10.222.0.79 () {60 vars in 1156 bytes} [Wed Aug 31 12:29:31 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 12:29:31.403108 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-9b3a2a58-cdf4-4142-a66b-ba882197e6cd tempest-VolumesNegativeTest-1906905764 tempest-VolumesNegativeTest-1906905764-project] Calling method '.version_select at 0x7f8d18011790>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:32.318252 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-09643bd8-879c-43ee-a820-d38786aa61b4 tempest-VolumesGetTestJSON-1907124060 tempest-VolumesGetTestJSON-1907124060-project] Action: 'create', calling method: .version_select at 0x7f8d18146e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1125163163", "metadata": {"Type": "work"}}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:29:32.365741 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.wsgi [None req-9b3a2a58-cdf4-4142-a66b-ba882197e6cd tempest-VolumesNegativeTest-1906905764 tempest-VolumesNegativeTest-1906905764-project] HTTP exception thrown: Volume tempest-invalid-868228503 could not be found. Aug 31 12:29:32.370193 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-9b3a2a58-cdf4-4142-a66b-ba882197e6cd tempest-VolumesNegativeTest-1906905764 tempest-VolumesNegativeTest-1906905764-project] Request method failure captured: Aug 31 12:29:32.370193 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-868228503 HTTP/1.1 Aug 31 12:29:32.370193 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept: application/json Aug 31 12:29:32.370193 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept-Encoding: identity Aug 31 12:29:32.370193 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Connection: close Aug 31 12:29:32.370193 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Length: 0 Aug 31 12:29:32.370193 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Type: application/json Aug 31 12:29:32.370193 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Host: 10.222.0.79 Aug 31 12:29:32.370193 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Openstack-System-Scope: None Aug 31 12:29:32.370193 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: User-Agent: python-urllib3/1.26.12 Aug 31 12:29:32.370193 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Auth-Token: gAAAAABjD1QpgHDw3ijeEAXvcHo2Bz_4W4sWsZ8cvoURUwd_1svktA0GO-y24suaGiOjNdo1HcPCaXRudc1i7_SXKF19VAzrqWPzhk9N4hryaHan9iFHJHUuF1ea1k6M8rLKOWHDQ6uhl5bXLsHHSATA3WGRKmbeWjm3j55cuboovwZyPWjElzA Aug 31 12:29:32.370193 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Id: None Aug 31 12:29:32.370193 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Name: None Aug 31 12:29:32.370193 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Identity-Status: Confirmed Aug 31 12:29:32.370193 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Is-Admin-Project: True Aug 31 12:29:32.370193 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Id: default Aug 31 12:29:32.370193 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Name: Default Aug 31 12:29:32.370193 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Id: ca25ca2519ae4697b952d9451321980d Aug 31 12:29:32.370193 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Name: tempest-VolumesNegativeTest-1906905764 Aug 31 12:29:32.370193 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Role: reader,member Aug 31 12:29:32.370193 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Roles: reader,member Aug 31 12:29:32.371737 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ca25ca2519ae4697b952d9451321980d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ca25ca2519ae4697b952d9451321980d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca25ca2519ae4697b952d9451321980d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca25ca2519ae4697b952d9451321980d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:29:32.371737 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant: tempest-VolumesNegativeTest-1906905764 Aug 31 12:29:32.371737 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Id: ca25ca2519ae4697b952d9451321980d Aug 31 12:29:32.371737 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Name: tempest-VolumesNegativeTest-1906905764 Aug 31 12:29:32.371737 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User: tempest-VolumesNegativeTest-1906905764-project Aug 31 12:29:32.371737 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Id: default Aug 31 12:29:32.371737 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Name: Default Aug 31 12:29:32.371737 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Id: 5a3b11bf184943698c459d79f158400b Aug 31 12:29:32.371737 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Name: tempest-VolumesNegativeTest-1906905764-project Aug 31 12:29:32.371737 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: method: Aug 31 12:29:32.371737 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: exception: Volume tempest-invalid-868228503 could not be found. Aug 31 12:29:32.371737 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: action_args: {'id': 'tempest-invalid-868228503'} Aug 31 12:29:32.371737 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:29:32.372535 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:32.372535 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:29:32.372535 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:29:32.372535 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 12:29:32.372535 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 12:29:32.372535 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 12:29:32.372535 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 12:29:32.372535 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 12:29:32.372535 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 12:29:32.372535 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 12:29:32.372535 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 12:29:32.372535 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:29:32.372535 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:29:32.372535 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:29:32.372535 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:29:32.372535 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-868228503 could not be found. (HTTP 404) (Request-ID: req-5ae954d1-1bb9-4fbc-b98d-723472311e6f) Aug 31 12:29:32.372535 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:32.372535 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:29:32.372535 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:32.375994 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:32.375994 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 12:29:32.375994 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 12:29:32.375994 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 12:29:32.375994 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 12:29:32.375994 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 12:29:32.375994 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 12:29:32.375994 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 12:29:32.375994 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 12:29:32.375994 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:29:32.375994 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:29:32.375994 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 12:29:32.375994 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 12:29:32.375994 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 12:29:32.375994 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 12:29:32.375994 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 12:29:32.375994 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 12:29:32.375994 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 12:29:32.375994 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 12:29:32.379426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:29:32.379426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:29:32.379426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:29:32.379426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:29:32.379426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-868228503 could not be found. Aug 31 12:29:32.379426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:32.379426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:29:32.379426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:32.379426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:32.379426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:29:32.379426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:29:32.379426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:29:32.379426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:29:32.379426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:29:32.379426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:29:32.379426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:29:32.379426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:29:32.379426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 12:29:32.379426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:29:32.379426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-868228503 could not be found. Aug 31 12:29:32.383222 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:32.383222 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:29:32.383222 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:32.383222 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:32.383222 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:29:32.383222 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:29:32.383222 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:29:32.383222 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:29:32.383222 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-868228503 could not be found. Aug 31 12:29:32.383222 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:32.393482 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-9b3a2a58-cdf4-4142-a66b-ba882197e6cd tempest-VolumesNegativeTest-1906905764 tempest-VolumesNegativeTest-1906905764-project] Returning 404 to user: Volume tempest-invalid-868228503 could not be found. {{(pid=120749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:29:32.395263 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-9b3a2a58-cdf4-4142-a66b-ba882197e6cd tempest-VolumesNegativeTest-1906905764 tempest-VolumesNegativeTest-1906905764-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/tempest-invalid-868228503" status: 404 len: 98 microversion: 2.1 time: 0.999161 Aug 31 12:29:32.398842 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 4/4] 10.222.0.79 () {58 vars in 1215 bytes} [Wed Aug 31 12:29:31 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-868228503 => generated 98 bytes in 1003 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 12:29:32.430180 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-629d398c-76e5-4930-a166-ce23c51e6fb6 tempest-VolumesNegativeTest-1906905764 tempest-VolumesNegativeTest-1906905764-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.019255 Aug 31 12:29:32.430981 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 5/5] 10.222.0.79 () {58 vars in 1140 bytes} [Wed Aug 31 12:29:32 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 12:29:32.469362 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-9dbe751d-52b8-443d-84dd-07f59aa30281 tempest-VolumesNegativeTest-1906905764 tempest-VolumesNegativeTest-1906905764-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.017431 Aug 31 12:29:32.474390 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 6/6] 10.222.0.79 () {58 vars in 1137 bytes} [Wed Aug 31 12:29:32 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 12:29:32.491271 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-fb0d353b-5a0c-4e81-a517-8ee4ace5f187 tempest-VolumesNegativeTest-1906905764 tempest-VolumesNegativeTest-1906905764-project] Calling method '.version_select at 0x7f8d17f51dc0>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:33.336286 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.wsgi [None req-fb0d353b-5a0c-4e81-a517-8ee4ace5f187 tempest-VolumesNegativeTest-1906905764 tempest-VolumesNegativeTest-1906905764-project] HTTP exception thrown: Volume ec3da92c-a0ac-4436-aa2b-49bca6c99bf6 could not be found. Aug 31 12:29:33.338996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-fb0d353b-5a0c-4e81-a517-8ee4ace5f187 tempest-VolumesNegativeTest-1906905764 tempest-VolumesNegativeTest-1906905764-project] Request method failure captured: Aug 31 12:29:33.338996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: request: DELETE /compute/v2.1/os-volumes/ec3da92c-a0ac-4436-aa2b-49bca6c99bf6 HTTP/1.1 Aug 31 12:29:33.338996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept: application/json Aug 31 12:29:33.338996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept-Encoding: identity Aug 31 12:29:33.338996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Connection: close Aug 31 12:29:33.338996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Length: 0 Aug 31 12:29:33.338996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Type: application/json Aug 31 12:29:33.338996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Host: 10.222.0.79 Aug 31 12:29:33.338996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Openstack-System-Scope: None Aug 31 12:29:33.338996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: User-Agent: python-urllib3/1.26.12 Aug 31 12:29:33.338996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Auth-Token: gAAAAABjD1QpgHDw3ijeEAXvcHo2Bz_4W4sWsZ8cvoURUwd_1svktA0GO-y24suaGiOjNdo1HcPCaXRudc1i7_SXKF19VAzrqWPzhk9N4hryaHan9iFHJHUuF1ea1k6M8rLKOWHDQ6uhl5bXLsHHSATA3WGRKmbeWjm3j55cuboovwZyPWjElzA Aug 31 12:29:33.338996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Id: None Aug 31 12:29:33.338996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Name: None Aug 31 12:29:33.338996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Identity-Status: Confirmed Aug 31 12:29:33.338996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Is-Admin-Project: True Aug 31 12:29:33.338996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Id: default Aug 31 12:29:33.338996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Name: Default Aug 31 12:29:33.338996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Id: ca25ca2519ae4697b952d9451321980d Aug 31 12:29:33.338996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Name: tempest-VolumesNegativeTest-1906905764 Aug 31 12:29:33.338996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Role: reader,member Aug 31 12:29:33.338996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Roles: reader,member Aug 31 12:29:33.341092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ca25ca2519ae4697b952d9451321980d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ca25ca2519ae4697b952d9451321980d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca25ca2519ae4697b952d9451321980d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca25ca2519ae4697b952d9451321980d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:29:33.341092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant: tempest-VolumesNegativeTest-1906905764 Aug 31 12:29:33.341092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Id: ca25ca2519ae4697b952d9451321980d Aug 31 12:29:33.341092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Name: tempest-VolumesNegativeTest-1906905764 Aug 31 12:29:33.341092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User: tempest-VolumesNegativeTest-1906905764-project Aug 31 12:29:33.341092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Id: default Aug 31 12:29:33.341092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Name: Default Aug 31 12:29:33.341092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Id: 5a3b11bf184943698c459d79f158400b Aug 31 12:29:33.341092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Name: tempest-VolumesNegativeTest-1906905764-project Aug 31 12:29:33.341092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: method: Aug 31 12:29:33.341092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: exception: Volume ec3da92c-a0ac-4436-aa2b-49bca6c99bf6 could not be found. Aug 31 12:29:33.341092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: action_args: {'id': 'ec3da92c-a0ac-4436-aa2b-49bca6c99bf6'} Aug 31 12:29:33.341092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:29:33.342092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:33.342092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:29:33.342092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:29:33.342092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 12:29:33.342092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 12:29:33.342092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 12:29:33.342092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 12:29:33.342092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 12:29:33.342092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 12:29:33.342092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 12:29:33.342092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 12:29:33.342092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:29:33.342092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:29:33.342092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:29:33.342092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:29:33.342092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ec3da92c-a0ac-4436-aa2b-49bca6c99bf6 could not be found. (HTTP 404) (Request-ID: req-8adda19b-0f42-4d4a-a91b-34a380accfbe) Aug 31 12:29:33.342092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:33.342092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:29:33.342092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:33.343349 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:33.343349 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 12:29:33.343349 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 12:29:33.343349 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 12:29:33.343349 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 12:29:33.343349 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 12:29:33.343349 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 12:29:33.343349 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 12:29:33.343349 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 12:29:33.343349 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:29:33.343349 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:29:33.343349 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 12:29:33.343349 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 12:29:33.343349 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 12:29:33.343349 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 12:29:33.343349 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 12:29:33.343349 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 12:29:33.343349 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 12:29:33.343349 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 12:29:33.349092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:29:33.349092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:29:33.349092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:29:33.349092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:29:33.349092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ec3da92c-a0ac-4436-aa2b-49bca6c99bf6 could not be found. Aug 31 12:29:33.349092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:33.349092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:29:33.349092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:33.349092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:33.349092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:29:33.349092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:29:33.349092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:29:33.349092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:29:33.349092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:29:33.349092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:29:33.349092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:29:33.349092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:29:33.349092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 12:29:33.349092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:29:33.350649 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ec3da92c-a0ac-4436-aa2b-49bca6c99bf6 could not be found. Aug 31 12:29:33.350649 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:33.350649 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:29:33.350649 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:33.350649 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:33.350649 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:29:33.350649 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:29:33.350649 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:29:33.350649 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:29:33.350649 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ec3da92c-a0ac-4436-aa2b-49bca6c99bf6 could not be found. Aug 31 12:29:33.350649 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:33.350649 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-fb0d353b-5a0c-4e81-a517-8ee4ace5f187 tempest-VolumesNegativeTest-1906905764 tempest-VolumesNegativeTest-1906905764-project] Returning 404 to user: Volume ec3da92c-a0ac-4436-aa2b-49bca6c99bf6 could not be found. {{(pid=120749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:29:33.350649 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-fb0d353b-5a0c-4e81-a517-8ee4ace5f187 tempest-VolumesNegativeTest-1906905764 tempest-VolumesNegativeTest-1906905764-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/ec3da92c-a0ac-4436-aa2b-49bca6c99bf6" status: 404 len: 109 microversion: 2.1 time: 0.866732 Aug 31 12:29:33.350649 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 7/7] 10.222.0.79 () {58 vars in 1248 bytes} [Wed Aug 31 12:29:32 2022] DELETE /compute/v2.1/os-volumes/ec3da92c-a0ac-4436-aa2b-49bca6c99bf6 => generated 109 bytes in 869 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:29:33.363107 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-0a9f10d1-4073-48a6-93da-356a6fa9d35a tempest-VolumesNegativeTest-1906905764 tempest-VolumesNegativeTest-1906905764-project] Calling method '.version_select at 0x7f8d17f51670>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:33.542101 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.wsgi [None req-0a9f10d1-4073-48a6-93da-356a6fa9d35a tempest-VolumesNegativeTest-1906905764 tempest-VolumesNegativeTest-1906905764-project] HTTP exception thrown: Volume d276d4b4-2431-4e26-af2a-ca9e38675990 could not be found. Aug 31 12:29:33.545294 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-0a9f10d1-4073-48a6-93da-356a6fa9d35a tempest-VolumesNegativeTest-1906905764 tempest-VolumesNegativeTest-1906905764-project] Request method failure captured: Aug 31 12:29:33.545294 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: request: GET /compute/v2.1/os-volumes/d276d4b4-2431-4e26-af2a-ca9e38675990 HTTP/1.1 Aug 31 12:29:33.545294 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept: application/json Aug 31 12:29:33.545294 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept-Encoding: identity Aug 31 12:29:33.545294 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Connection: close Aug 31 12:29:33.545294 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Length: 0 Aug 31 12:29:33.545294 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Type: application/json Aug 31 12:29:33.545294 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Host: 10.222.0.79 Aug 31 12:29:33.545294 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Openstack-System-Scope: None Aug 31 12:29:33.545294 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: User-Agent: python-urllib3/1.26.12 Aug 31 12:29:33.545294 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Auth-Token: gAAAAABjD1QpgHDw3ijeEAXvcHo2Bz_4W4sWsZ8cvoURUwd_1svktA0GO-y24suaGiOjNdo1HcPCaXRudc1i7_SXKF19VAzrqWPzhk9N4hryaHan9iFHJHUuF1ea1k6M8rLKOWHDQ6uhl5bXLsHHSATA3WGRKmbeWjm3j55cuboovwZyPWjElzA Aug 31 12:29:33.545294 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Id: None Aug 31 12:29:33.545294 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Name: None Aug 31 12:29:33.545294 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Identity-Status: Confirmed Aug 31 12:29:33.545294 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Is-Admin-Project: True Aug 31 12:29:33.545294 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Id: default Aug 31 12:29:33.545294 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Name: Default Aug 31 12:29:33.545294 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Id: ca25ca2519ae4697b952d9451321980d Aug 31 12:29:33.545294 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Name: tempest-VolumesNegativeTest-1906905764 Aug 31 12:29:33.545294 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Role: reader,member Aug 31 12:29:33.545294 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Roles: reader,member Aug 31 12:29:33.547003 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ca25ca2519ae4697b952d9451321980d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ca25ca2519ae4697b952d9451321980d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca25ca2519ae4697b952d9451321980d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca25ca2519ae4697b952d9451321980d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:29:33.547003 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant: tempest-VolumesNegativeTest-1906905764 Aug 31 12:29:33.547003 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Id: ca25ca2519ae4697b952d9451321980d Aug 31 12:29:33.547003 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Name: tempest-VolumesNegativeTest-1906905764 Aug 31 12:29:33.547003 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User: tempest-VolumesNegativeTest-1906905764-project Aug 31 12:29:33.547003 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Id: default Aug 31 12:29:33.547003 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Name: Default Aug 31 12:29:33.547003 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Id: 5a3b11bf184943698c459d79f158400b Aug 31 12:29:33.547003 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Name: tempest-VolumesNegativeTest-1906905764-project Aug 31 12:29:33.547003 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: method: Aug 31 12:29:33.547003 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: exception: Volume d276d4b4-2431-4e26-af2a-ca9e38675990 could not be found. Aug 31 12:29:33.547003 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: action_args: {'id': 'd276d4b4-2431-4e26-af2a-ca9e38675990'} Aug 31 12:29:33.547003 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:29:33.547910 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:33.547910 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:29:33.547910 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:29:33.547910 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 12:29:33.547910 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 12:29:33.547910 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 12:29:33.547910 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 12:29:33.547910 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:29:33.547910 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:29:33.547910 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:29:33.547910 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:29:33.547910 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:29:33.547910 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:29:33.547910 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:29:33.547910 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:29:33.547910 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d276d4b4-2431-4e26-af2a-ca9e38675990 could not be found. (HTTP 404) (Request-ID: req-b48c7722-d8d4-4f02-8666-71c43e59985a) Aug 31 12:29:33.547910 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:33.547910 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:29:33.547910 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:33.549057 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:33.549057 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 12:29:33.549057 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 12:29:33.549057 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 12:29:33.549057 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 12:29:33.549057 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 12:29:33.549057 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 12:29:33.549057 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 12:29:33.549057 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 12:29:33.549057 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:29:33.549057 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:29:33.549057 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 12:29:33.549057 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 12:29:33.549057 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 12:29:33.549057 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 12:29:33.549057 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:29:33.549057 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:29:33.549057 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:29:33.549057 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:29:33.550198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:29:33.550198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:29:33.550198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:29:33.550198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:29:33.550198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d276d4b4-2431-4e26-af2a-ca9e38675990 could not be found. Aug 31 12:29:33.550198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:33.550198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:29:33.550198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:33.550198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:33.550198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:29:33.550198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:29:33.550198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:29:33.550198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:29:33.550198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:29:33.550198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:29:33.550198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:29:33.550198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:29:33.550198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 12:29:33.550198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:29:33.551971 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d276d4b4-2431-4e26-af2a-ca9e38675990 could not be found. Aug 31 12:29:33.551971 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:33.551971 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:29:33.551971 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:33.551971 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:33.551971 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:29:33.551971 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:29:33.551971 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:29:33.551971 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:29:33.551971 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d276d4b4-2431-4e26-af2a-ca9e38675990 could not be found. Aug 31 12:29:33.551971 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:29:33.551971 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-0a9f10d1-4073-48a6-93da-356a6fa9d35a tempest-VolumesNegativeTest-1906905764 tempest-VolumesNegativeTest-1906905764-project] Returning 404 to user: Volume d276d4b4-2431-4e26-af2a-ca9e38675990 could not be found. {{(pid=120749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:29:33.551971 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-0a9f10d1-4073-48a6-93da-356a6fa9d35a tempest-VolumesNegativeTest-1906905764 tempest-VolumesNegativeTest-1906905764-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/d276d4b4-2431-4e26-af2a-ca9e38675990" status: 404 len: 109 microversion: 2.1 time: 0.197449 Aug 31 12:29:33.551971 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 8/8] 10.222.0.79 () {58 vars in 1245 bytes} [Wed Aug 31 12:29:33 2022] GET /compute/v2.1/os-volumes/d276d4b4-2431-4e26-af2a-ca9e38675990 => generated 109 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:29:33.851286 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-09643bd8-879c-43ee-a820-d38786aa61b4 tempest-VolumesGetTestJSON-1907124060 tempest-VolumesGetTestJSON-1907124060-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.339328 Aug 31 12:29:33.853085 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 1/9] 10.222.0.79 () {60 vars in 1156 bytes} [Wed Aug 31 12:29:30 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3347 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 12:29:33.881401 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-31bd196e-2f82-41c7-aee7-86be0c6bb5b1 tempest-VolumesGetTestJSON-1907124060 tempest-VolumesGetTestJSON-1907124060-project] Calling method '.version_select at 0x7f8d17f51670>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:34.092354 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-31bd196e-2f82-41c7-aee7-86be0c6bb5b1 tempest-VolumesGetTestJSON-1907124060 tempest-VolumesGetTestJSON-1907124060-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/bf0c8586-20b9-4517-8fde-07fd8872a6d8" status: 200 len: 353 microversion: 2.1 time: 0.224566 Aug 31 12:29:34.093641 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 9/10] 10.222.0.79 () {58 vars in 1245 bytes} [Wed Aug 31 12:29:33 2022] GET /compute/v2.1/os-volumes/bf0c8586-20b9-4517-8fde-07fd8872a6d8 => generated 353 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:35.141076 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-91927208-26ce-4eb9-bc6d-c947df6a9e13 tempest-VolumesGetTestJSON-1907124060 tempest-VolumesGetTestJSON-1907124060-project] Calling method '.version_select at 0x7f8d17fbfca0>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:35.314567 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-91927208-26ce-4eb9-bc6d-c947df6a9e13 tempest-VolumesGetTestJSON-1907124060 tempest-VolumesGetTestJSON-1907124060-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/bf0c8586-20b9-4517-8fde-07fd8872a6d8" status: 200 len: 354 microversion: 2.1 time: 0.183362 Aug 31 12:29:35.323143 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 2/11] 10.222.0.79 () {58 vars in 1245 bytes} [Wed Aug 31 12:29:35 2022] GET /compute/v2.1/os-volumes/bf0c8586-20b9-4517-8fde-07fd8872a6d8 => generated 354 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:35.328286 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-41b820de-83ed-41a2-ac04-b27b81a6d045 tempest-VolumesGetTestJSON-1907124060 tempest-VolumesGetTestJSON-1907124060-project] Calling method '.version_select at 0x7f8d18011af0>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:35.461996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-41b820de-83ed-41a2-ac04-b27b81a6d045 tempest-VolumesGetTestJSON-1907124060 tempest-VolumesGetTestJSON-1907124060-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/bf0c8586-20b9-4517-8fde-07fd8872a6d8" status: 200 len: 354 microversion: 2.1 time: 0.137687 Aug 31 12:29:35.463175 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 10/12] 10.222.0.79 () {58 vars in 1245 bytes} [Wed Aug 31 12:29:35 2022] GET /compute/v2.1/os-volumes/bf0c8586-20b9-4517-8fde-07fd8872a6d8 => generated 354 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:35.485021 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-7fd79124-6271-4cc2-a6ef-d420882d045c tempest-VolumesGetTestJSON-1907124060 tempest-VolumesGetTestJSON-1907124060-project] Calling method '.version_select at 0x7f8d17fe13a0>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:35.613520 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-7fd79124-6271-4cc2-a6ef-d420882d045c tempest-VolumesGetTestJSON-1907124060 tempest-VolumesGetTestJSON-1907124060-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/bf0c8586-20b9-4517-8fde-07fd8872a6d8" status: 202 len: 0 microversion: 2.1 time: 0.133008 Aug 31 12:29:35.614241 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 3/13] 10.222.0.79 () {58 vars in 1248 bytes} [Wed Aug 31 12:29:35 2022] DELETE /compute/v2.1/os-volumes/bf0c8586-20b9-4517-8fde-07fd8872a6d8 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:29:35.623641 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-d2f29858-3bd4-4214-99fd-dc5e4c0572c9 tempest-VolumesGetTestJSON-1907124060 tempest-VolumesGetTestJSON-1907124060-project] Calling method '.version_select at 0x7f8d17eed670>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:35.687184 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-d2f29858-3bd4-4214-99fd-dc5e4c0572c9 tempest-VolumesGetTestJSON-1907124060 tempest-VolumesGetTestJSON-1907124060-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/bf0c8586-20b9-4517-8fde-07fd8872a6d8" status: 200 len: 353 microversion: 2.1 time: 0.067533 Aug 31 12:29:35.688002 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 11/14] 10.222.0.79 () {58 vars in 1245 bytes} [Wed Aug 31 12:29:35 2022] GET /compute/v2.1/os-volumes/bf0c8586-20b9-4517-8fde-07fd8872a6d8 => generated 353 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:36.703878 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-fce71de2-8c48-467e-ab45-9601a5d14eca tempest-VolumesGetTestJSON-1907124060 tempest-VolumesGetTestJSON-1907124060-project] Calling method '.version_select at 0x7f8d17fe1a60>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:36.752293 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-fce71de2-8c48-467e-ab45-9601a5d14eca tempest-VolumesGetTestJSON-1907124060 tempest-VolumesGetTestJSON-1907124060-project] HTTP exception thrown: Volume bf0c8586-20b9-4517-8fde-07fd8872a6d8 could not be found. Aug 31 12:29:36.757151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-fce71de2-8c48-467e-ab45-9601a5d14eca tempest-VolumesGetTestJSON-1907124060 tempest-VolumesGetTestJSON-1907124060-project] Request method failure captured: Aug 31 12:29:36.757151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: GET /compute/v2.1/os-volumes/bf0c8586-20b9-4517-8fde-07fd8872a6d8 HTTP/1.1 Aug 31 12:29:36.757151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:29:36.757151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:29:36.757151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:29:36.757151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 0 Aug 31 12:29:36.757151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:29:36.757151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:29:36.757151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:29:36.757151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:29:36.757151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1QqF_TvgZ1g1Si_522TLqlu1zEsqkT-s2sEbTNLaE-K3nBUNDOHxtvBOMLJrD7d8CxRU3vX5e312SWcEXGh8Ou5GXADZRJ2nsdA8QFyA_hhs9gZvcSPE4gkuMsFYY6CmNHln9Di2AT5EmXikAKRD2uyu7BjMjExzDZMJ5k9KycTWe0 Aug 31 12:29:36.757151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:29:36.757151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:29:36.757151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:29:36.757151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:29:36.757151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:29:36.757151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:29:36.757151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: 595bc4e7605048c1bf0d807a1bff9ccd Aug 31 12:29:36.757151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-VolumesGetTestJSON-1907124060 Aug 31 12:29:36.757151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:29:36.757151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:29:36.758456 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/595bc4e7605048c1bf0d807a1bff9ccd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_595bc4e7605048c1bf0d807a1bff9ccd", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/595bc4e7605048c1bf0d807a1bff9ccd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/595bc4e7605048c1bf0d807a1bff9ccd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:29:36.758456 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-VolumesGetTestJSON-1907124060 Aug 31 12:29:36.758456 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: 595bc4e7605048c1bf0d807a1bff9ccd Aug 31 12:29:36.758456 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-VolumesGetTestJSON-1907124060 Aug 31 12:29:36.758456 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-VolumesGetTestJSON-1907124060-project Aug 31 12:29:36.758456 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:29:36.758456 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:29:36.758456 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: 63856a53aed44ef0b5388b1d050899fa Aug 31 12:29:36.758456 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-VolumesGetTestJSON-1907124060-project Aug 31 12:29:36.758456 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: Aug 31 12:29:36.758456 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Volume bf0c8586-20b9-4517-8fde-07fd8872a6d8 could not be found. Aug 31 12:29:36.758456 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'id': 'bf0c8586-20b9-4517-8fde-07fd8872a6d8'} Aug 31 12:29:36.758456 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:29:36.759408 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:36.759408 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:29:36.759408 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:29:36.759408 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 12:29:36.759408 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 12:29:36.759408 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 12:29:36.759408 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 12:29:36.759408 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:29:36.759408 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:29:36.759408 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:29:36.759408 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:29:36.759408 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:29:36.759408 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:29:36.759408 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:29:36.759408 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:29:36.759408 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bf0c8586-20b9-4517-8fde-07fd8872a6d8 could not be found. (HTTP 404) (Request-ID: req-50a8494d-d910-40eb-a8b8-5440fef2d616) Aug 31 12:29:36.759408 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:29:36.759408 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:29:36.759408 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:29:36.760448 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:36.760448 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 12:29:36.760448 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 12:29:36.760448 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 12:29:36.760448 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 12:29:36.760448 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 12:29:36.760448 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 12:29:36.760448 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 12:29:36.760448 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 12:29:36.760448 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:29:36.760448 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:29:36.760448 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 12:29:36.760448 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 12:29:36.760448 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 12:29:36.760448 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 12:29:36.760448 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:29:36.760448 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:29:36.760448 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:29:36.760448 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:29:36.761434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:29:36.761434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:29:36.761434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:29:36.761434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:29:36.761434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bf0c8586-20b9-4517-8fde-07fd8872a6d8 could not be found. Aug 31 12:29:36.761434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:29:36.761434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:29:36.761434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:29:36.761434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:36.761434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:29:36.761434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:29:36.761434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:29:36.761434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:29:36.761434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:29:36.761434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:29:36.761434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:29:36.761434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:29:36.761434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 12:29:36.761434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:29:36.766794 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bf0c8586-20b9-4517-8fde-07fd8872a6d8 could not be found. Aug 31 12:29:36.766794 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:29:36.766794 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:29:36.766794 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:29:36.766794 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:36.766794 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:29:36.766794 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:29:36.766794 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:29:36.766794 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:29:36.766794 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bf0c8586-20b9-4517-8fde-07fd8872a6d8 could not be found. Aug 31 12:29:36.766794 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:29:36.766794 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-fce71de2-8c48-467e-ab45-9601a5d14eca tempest-VolumesGetTestJSON-1907124060 tempest-VolumesGetTestJSON-1907124060-project] Returning 404 to user: Volume bf0c8586-20b9-4517-8fde-07fd8872a6d8 could not be found. {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:29:36.771071 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-fce71de2-8c48-467e-ab45-9601a5d14eca tempest-VolumesGetTestJSON-1907124060 tempest-VolumesGetTestJSON-1907124060-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/bf0c8586-20b9-4517-8fde-07fd8872a6d8" status: 404 len: 109 microversion: 2.1 time: 0.069366 Aug 31 12:29:36.775946 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 4/15] 10.222.0.79 () {58 vars in 1245 bytes} [Wed Aug 31 12:29:36 2022] GET /compute/v2.1/os-volumes/bf0c8586-20b9-4517-8fde-07fd8872a6d8 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:29:48.386377 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-1c7ce0a5-f46b-4dc4-b10d-50bb50ffe61f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Action: 'create', calling method: .version_select at 0x7f8d17eed9d0>, body: {"keypair": {"name": "tempest-keypair-2113646768", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwXKLuzaA/8XnOc22v5X0sy2bafBmlZWA5JgXzBUcffdZjrQ9XWivve4WLZxmrSPJutq4/fyKcKmYSVgK9N/q7/woQZPhY1Oy5voOApcDXsmcdUgoIy6X4AZrTC9IVq3g=="}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:29:48.743612 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-298b1068-760f-4442-a258-7acc69f0eeb1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1383881469", "imageRef": "2aaf4ebd-395b-468e-bb6b-c663d01edea0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:29:48.756093 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-1c7ce0a5-f46b-4dc4-b10d-50bb50ffe61f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Getting quotas for project 0b1d7ad43ff24c31af3b53349b2063cd. Resources: {'key_pairs'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:29:48.784524 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-1c7ce0a5-f46b-4dc4-b10d-50bb50ffe61f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Getting quotas for user 937aa5c23271467f83b05f570fde7468 and project 0b1d7ad43ff24c31af3b53349b2063cd. Resources: {'key_pairs'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:29:48.981234 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-1c7ce0a5-f46b-4dc4-b10d-50bb50ffe61f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.267346 Aug 31 12:29:49.001507 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 12/16] 10.222.0.79 () {60 vars in 1159 bytes} [Wed Aug 31 12:29:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:49.172984 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.network.neutron [None req-298b1068-760f-4442-a258-7acc69f0eeb1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] validate_networks() for [('fcfceaa8-05fa-4d60-80d3-79a71d2a7781', None, None, None, None, None)] {{(pid=120750) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:29:49.280389 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-89e2b0f1-7a39-446b-9f0e-a3da27c3626f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Action: 'create', calling method: .version_select at 0x7f8d17ec61f0>, body: {"keypair": {"name": "tempest-keypair-1511353979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzyFtrKkJJPKUyMBSBIltJ+ZyIj7o5K2vK2odFLVqNW1jgtsi7acJfQI6nt0KjPSbWeJNEuRYGp0JmT+H0KCLRU+ICbll4dn//4yuPDAWeuuENqZ5eCi644lvVj4+6vxg=="}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:29:49.331032 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-89e2b0f1-7a39-446b-9f0e-a3da27c3626f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Getting quotas for project 93d78bffa2c740b1aa7e09882a90eb9a. Resources: {'key_pairs'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:29:49.342708 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-89e2b0f1-7a39-446b-9f0e-a3da27c3626f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Getting quotas for user ee19faf2a2c54b19a9dc01d28f045b3a and project 93d78bffa2c740b1aa7e09882a90eb9a. Resources: {'key_pairs'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:29:49.411239 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-89e2b0f1-7a39-446b-9f0e-a3da27c3626f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.388112 Aug 31 12:29:49.412741 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 13/17] 10.222.0.79 () {62 vars in 1200 bytes} [Wed Aug 31 12:29:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 395 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 12:29:51.819083 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-44f1e1fd-d0bc-4ba5-99c3-aae620ae47a1 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-354397059", "imageRef": "2aaf4ebd-395b-468e-bb6b-c663d01edea0", "flavorRef": "452", "networks": [{"uuid": "9364e045-f185-4812-aed7-aac02c4d1c92"}]}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:29:51.977046 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.network.neutron [None req-44f1e1fd-d0bc-4ba5-99c3-aae620ae47a1 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] validate_networks() for [('9364e045-f185-4812-aed7-aac02c4d1c92', None, None, None, None, None)] {{(pid=120749) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:29:52.419199 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-298b1068-760f-4442-a258-7acc69f0eeb1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Flavor limits 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:29:52.419709 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-298b1068-760f-4442-a258-7acc69f0eeb1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Image limits 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:29:52.420102 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-298b1068-760f-4442-a258-7acc69f0eeb1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Flavor pref 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:29:52.420513 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-298b1068-760f-4442-a258-7acc69f0eeb1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Image pref 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:29:52.420934 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-298b1068-760f-4442-a258-7acc69f0eeb1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:29:52.471424 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-298b1068-760f-4442-a258-7acc69f0eeb1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:52.472015 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-298b1068-760f-4442-a258-7acc69f0eeb1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:52.472628 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-298b1068-760f-4442-a258-7acc69f0eeb1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:52.475209 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-298b1068-760f-4442-a258-7acc69f0eeb1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:52.475957 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-298b1068-760f-4442-a258-7acc69f0eeb1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:52.479619 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-298b1068-760f-4442-a258-7acc69f0eeb1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:52.564424 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-298b1068-760f-4442-a258-7acc69f0eeb1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Getting quotas for project 7327d2f6422e4bdb9e250e44987dace3. Resources: {'cores', 'ram', 'instances'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:29:52.594423 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-298b1068-760f-4442-a258-7acc69f0eeb1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Getting quotas for user 64886d73c79649d1a824170a33f53fcb and project 7327d2f6422e4bdb9e250e44987dace3. Resources: {'cores', 'ram', 'instances'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:29:52.646305 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-298b1068-760f-4442-a258-7acc69f0eeb1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Going to run 1 instances... {{(pid=120750) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:29:52.654454 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-298b1068-760f-4442-a258-7acc69f0eeb1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aaf4ebd-395b-468e-bb6b-c663d01edea0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120750) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:29:52.888517 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-298b1068-760f-4442-a258-7acc69f0eeb1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.390633 Aug 31 12:29:52.892143 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 5/18] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 31 12:29:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 4396 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:29:52.905710 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-04ffdd6b-19d9-4aa1-ad7e-fd7e2a91a3bc tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:52.913251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-04ffdd6b-19d9-4aa1-ad7e-fd7e2a91a3bc tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:53.633167 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-04ffdd6b-19d9-4aa1-ad7e-fd7e2a91a3bc tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:29:53.665725 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-04ffdd6b-19d9-4aa1-ad7e-fd7e2a91a3bc tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1222 microversion: 2.1 time: 0.764998 Aug 31 12:29:53.666330 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 6/19] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:29:52 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1222 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:29:53.789391 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-43b775e0-544c-44f6-8acd-fc886355d562 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2070484890", "imageRef": "2aaf4ebd-395b-468e-bb6b-c663d01edea0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:29:53.922734 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.network.neutron [None req-43b775e0-544c-44f6-8acd-fc886355d562 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] validate_networks() for [('fcfceaa8-05fa-4d60-80d3-79a71d2a7781', None, None, None, None, None)] {{(pid=120750) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:29:54.829061 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-44f1e1fd-d0bc-4ba5-99c3-aae620ae47a1 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Flavor limits 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:29:54.829704 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-44f1e1fd-d0bc-4ba5-99c3-aae620ae47a1 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Image limits 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:29:54.830096 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-44f1e1fd-d0bc-4ba5-99c3-aae620ae47a1 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Flavor pref 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:29:54.830614 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-44f1e1fd-d0bc-4ba5-99c3-aae620ae47a1 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Image pref 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:29:54.831142 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-44f1e1fd-d0bc-4ba5-99c3-aae620ae47a1 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:29:54.874427 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-44f1e1fd-d0bc-4ba5-99c3-aae620ae47a1 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:54.874966 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-44f1e1fd-d0bc-4ba5-99c3-aae620ae47a1 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:54.875408 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-44f1e1fd-d0bc-4ba5-99c3-aae620ae47a1 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:54.876163 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-44f1e1fd-d0bc-4ba5-99c3-aae620ae47a1 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:54.876618 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-44f1e1fd-d0bc-4ba5-99c3-aae620ae47a1 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:54.877047 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-44f1e1fd-d0bc-4ba5-99c3-aae620ae47a1 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:55.018693 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-44f1e1fd-d0bc-4ba5-99c3-aae620ae47a1 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Getting quotas for project 67cc2121d964451892be22fdcdd78b63. Resources: {'cores', 'ram', 'instances'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:29:55.036301 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-44f1e1fd-d0bc-4ba5-99c3-aae620ae47a1 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Getting quotas for user f8a3ebaaec7442039ecda2d63c54cc59 and project 67cc2121d964451892be22fdcdd78b63. Resources: {'cores', 'ram', 'instances'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:29:55.100151 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-44f1e1fd-d0bc-4ba5-99c3-aae620ae47a1 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Going to run 1 instances... {{(pid=120749) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:29:55.112574 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-44f1e1fd-d0bc-4ba5-99c3-aae620ae47a1 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aaf4ebd-395b-468e-bb6b-c663d01edea0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:29:55.268231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-44f1e1fd-d0bc-4ba5-99c3-aae620ae47a1 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.573258 Aug 31 12:29:55.269945 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 14/20] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 31 12:29:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 12:29:55.284539 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-3e3688c0-76e4-4459-8795-0827714790be tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-789082131", "imageRef": "2aaf4ebd-395b-468e-bb6b-c663d01edea0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a2647de8-4bdf-4f94-856d-7adc190c4c35"}], "security_groups": [{"name": "tempest-securitygroup--206315312"}], "key_name": "tempest-keypair-2113646768", "user_data": "}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:29:55.638745 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.network.neutron [None req-3e3688c0-76e4-4459-8795-0827714790be tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] validate_networks() for [('a2647de8-4bdf-4f94-856d-7adc190c4c35', None, None, None, None, None)] {{(pid=120749) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:29:56.258091 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-43b775e0-544c-44f6-8acd-fc886355d562 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Flavor limits 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:29:56.258715 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-43b775e0-544c-44f6-8acd-fc886355d562 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Image limits 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:29:56.259230 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-43b775e0-544c-44f6-8acd-fc886355d562 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Flavor pref 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:29:56.259640 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-43b775e0-544c-44f6-8acd-fc886355d562 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Image pref 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:29:56.260050 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-43b775e0-544c-44f6-8acd-fc886355d562 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:29:56.313929 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-43b775e0-544c-44f6-8acd-fc886355d562 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:56.316869 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-43b775e0-544c-44f6-8acd-fc886355d562 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:56.320000 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-43b775e0-544c-44f6-8acd-fc886355d562 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:56.322726 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-43b775e0-544c-44f6-8acd-fc886355d562 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:56.332085 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-43b775e0-544c-44f6-8acd-fc886355d562 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:56.332632 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-43b775e0-544c-44f6-8acd-fc886355d562 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:56.424621 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-43b775e0-544c-44f6-8acd-fc886355d562 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Getting quotas for project 7327d2f6422e4bdb9e250e44987dace3. Resources: {'cores', 'ram', 'instances'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:29:56.453578 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-43b775e0-544c-44f6-8acd-fc886355d562 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Getting quotas for user 64886d73c79649d1a824170a33f53fcb and project 7327d2f6422e4bdb9e250e44987dace3. Resources: {'cores', 'ram', 'instances'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:29:56.517505 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-43b775e0-544c-44f6-8acd-fc886355d562 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Going to run 1 instances... {{(pid=120750) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:29:56.529027 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-43b775e0-544c-44f6-8acd-fc886355d562 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aaf4ebd-395b-468e-bb6b-c663d01edea0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120750) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:29:56.717532 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-43b775e0-544c-44f6-8acd-fc886355d562 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.932535 Aug 31 12:29:56.719099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 7/21] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 31 12:29:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 2935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:29:56.725655 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-bad27a7f-f71c-46b3-8f77-8ce434ca289f tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:56.726797 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-bad27a7f-f71c-46b3-8f77-8ce434ca289f tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:56.920956 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-bad27a7f-f71c-46b3-8f77-8ce434ca289f tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:29:56.955527 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-bad27a7f-f71c-46b3-8f77-8ce434ca289f tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1214 microversion: 2.1 time: 0.234310 Aug 31 12:29:56.962589 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 8/22] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:29:56 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1214 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:29:56.982091 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-40686045-f093-46a7-a0a9-f3af01ef91cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1967025200", "imageRef": "2aaf4ebd-395b-468e-bb6b-c663d01edea0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fd88f8d0-f886-493c-9800-db0ea697ebf3"}], "security_groups": [{"name": "tempest-securitygroup--2042224648"}], "key_name": "tempest-keypair-1511353979", "user_data": "}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:29:57.111246 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-3e3688c0-76e4-4459-8795-0827714790be tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Flavor limits 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:29:57.112353 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-3e3688c0-76e4-4459-8795-0827714790be tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Image limits 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:29:57.112994 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-3e3688c0-76e4-4459-8795-0827714790be tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Flavor pref 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:29:57.113580 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-3e3688c0-76e4-4459-8795-0827714790be tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Image pref 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:29:57.114393 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-3e3688c0-76e4-4459-8795-0827714790be tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:29:57.139731 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3e3688c0-76e4-4459-8795-0827714790be tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:57.140581 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3e3688c0-76e4-4459-8795-0827714790be tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:57.141916 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3e3688c0-76e4-4459-8795-0827714790be tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:57.144180 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3e3688c0-76e4-4459-8795-0827714790be tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:57.145724 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3e3688c0-76e4-4459-8795-0827714790be tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:57.147065 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3e3688c0-76e4-4459-8795-0827714790be tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:57.196860 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-3e3688c0-76e4-4459-8795-0827714790be tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Getting quotas for project 0b1d7ad43ff24c31af3b53349b2063cd. Resources: {'cores', 'ram', 'instances'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:29:57.216880 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-3e3688c0-76e4-4459-8795-0827714790be tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Getting quotas for user 937aa5c23271467f83b05f570fde7468 and project 0b1d7ad43ff24c31af3b53349b2063cd. Resources: {'cores', 'ram', 'instances'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:29:57.256246 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-3e3688c0-76e4-4459-8795-0827714790be tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Going to run 1 instances... {{(pid=120749) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:29:57.262926 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-3e3688c0-76e4-4459-8795-0827714790be tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aaf4ebd-395b-468e-bb6b-c663d01edea0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:29:57.421765 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.network.neutron [None req-40686045-f093-46a7-a0a9-f3af01ef91cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] validate_networks() for [('fd88f8d0-f886-493c-9800-db0ea697ebf3', None, None, None, None, None)] {{(pid=120750) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:29:57.507314 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-3e3688c0-76e4-4459-8795-0827714790be tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.235075 Aug 31 12:29:57.514557 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 15/23] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 31 12:29:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 2243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:29:57.543940 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-96128b77-016f-44a7-ac02-52233fe71dcd tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:57.548060 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-96128b77-016f-44a7-ac02-52233fe71dcd tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:58.128044 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-96128b77-016f-44a7-ac02-52233fe71dcd tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:29:58.201748 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-96128b77-016f-44a7-ac02-52233fe71dcd tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1222 microversion: 2.1 time: 0.685218 Aug 31 12:29:58.223228 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 16/24] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:29:57 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1222 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:29:58.223482 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-6d4fd7f2-b0db-4d67-8446-bdb160122792 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:58.226102 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-6d4fd7f2-b0db-4d67-8446-bdb160122792 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:58.588448 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-6d4fd7f2-b0db-4d67-8446-bdb160122792 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:29:58.643627 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-6d4fd7f2-b0db-4d67-8446-bdb160122792 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1237 microversion: 2.1 time: 0.428577 Aug 31 12:29:58.652973 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 17/25] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:29:58 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1237 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:29:58.662737 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-ab7ce282-193d-4d9f-824c-5c99d3ec0d5e tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:58.676009 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-ab7ce282-193d-4d9f-824c-5c99d3ec0d5e tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:58.698654 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ab7ce282-193d-4d9f-824c-5c99d3ec0d5e tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:58.705378 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ab7ce282-193d-4d9f-824c-5c99d3ec0d5e tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:58.705582 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ab7ce282-193d-4d9f-824c-5c99d3ec0d5e tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:58.706328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ab7ce282-193d-4d9f-824c-5c99d3ec0d5e tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:58.706892 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ab7ce282-193d-4d9f-824c-5c99d3ec0d5e tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:58.708221 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ab7ce282-193d-4d9f-824c-5c99d3ec0d5e tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:59.591891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-40686045-f093-46a7-a0a9-f3af01ef91cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Flavor limits 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:29:59.592884 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-40686045-f093-46a7-a0a9-f3af01ef91cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Image limits 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:29:59.592884 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-40686045-f093-46a7-a0a9-f3af01ef91cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Flavor pref 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:29:59.593688 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-40686045-f093-46a7-a0a9-f3af01ef91cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Image pref 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:29:59.594117 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-40686045-f093-46a7-a0a9-f3af01ef91cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:29:59.639160 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-40686045-f093-46a7-a0a9-f3af01ef91cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:59.639736 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-40686045-f093-46a7-a0a9-f3af01ef91cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:59.640693 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-40686045-f093-46a7-a0a9-f3af01ef91cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:59.641687 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-40686045-f093-46a7-a0a9-f3af01ef91cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:59.643079 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-40686045-f093-46a7-a0a9-f3af01ef91cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:59.643518 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-40686045-f093-46a7-a0a9-f3af01ef91cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:59.643812 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-ab7ce282-193d-4d9f-824c-5c99d3ec0d5e tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:29:59.701695 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-40686045-f093-46a7-a0a9-f3af01ef91cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Getting quotas for project 93d78bffa2c740b1aa7e09882a90eb9a. Resources: {'cores', 'ram', 'instances'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:29:59.706144 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-ab7ce282-193d-4d9f-824c-5c99d3ec0d5e tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1218 microversion: 2.1 time: 1.047418 Aug 31 12:29:59.708298 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-40686045-f093-46a7-a0a9-f3af01ef91cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Getting quotas for user ee19faf2a2c54b19a9dc01d28f045b3a and project 93d78bffa2c740b1aa7e09882a90eb9a. Resources: {'cores', 'ram', 'instances'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:29:59.729776 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 18/26] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:29:58 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1218 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:29:59.736166 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-40686045-f093-46a7-a0a9-f3af01ef91cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Going to run 1 instances... {{(pid=120750) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:29:59.744669 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-f9204722-0e6d-49d3-a043-6ffc2d40b1df tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:59.746668 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-f9204722-0e6d-49d3-a043-6ffc2d40b1df tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:59.749330 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-40686045-f093-46a7-a0a9-f3af01ef91cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aaf4ebd-395b-468e-bb6b-c663d01edea0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120750) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:29:59.795047 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f9204722-0e6d-49d3-a043-6ffc2d40b1df tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:59.813892 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f9204722-0e6d-49d3-a043-6ffc2d40b1df tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:59.815466 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f9204722-0e6d-49d3-a043-6ffc2d40b1df tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:59.816369 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f9204722-0e6d-49d3-a043-6ffc2d40b1df tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:59.817026 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f9204722-0e6d-49d3-a043-6ffc2d40b1df tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:59.817627 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f9204722-0e6d-49d3-a043-6ffc2d40b1df tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:59.846324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-40686045-f093-46a7-a0a9-f3af01ef91cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.879646 Aug 31 12:29:59.847130 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 9/27] 10.222.0.79 () {62 vars in 1188 bytes} [Wed Aug 31 12:29:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 2883 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 12:29:59.888251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b307eb8f-c420-4bbc-b446-1e82ed8f8440 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:59.889016 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-b307eb8f-c420-4bbc-b446-1e82ed8f8440 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:59.913398 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b307eb8f-c420-4bbc-b446-1e82ed8f8440 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:59.917541 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b307eb8f-c420-4bbc-b446-1e82ed8f8440 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:59.918619 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b307eb8f-c420-4bbc-b446-1e82ed8f8440 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:59.919495 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b307eb8f-c420-4bbc-b446-1e82ed8f8440 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:59.919972 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b307eb8f-c420-4bbc-b446-1e82ed8f8440 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:59.920403 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b307eb8f-c420-4bbc-b446-1e82ed8f8440 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:00.349692 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-f9204722-0e6d-49d3-a043-6ffc2d40b1df tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:00.413187 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-f9204722-0e6d-49d3-a043-6ffc2d40b1df tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1274 microversion: 2.1 time: 0.681189 Aug 31 12:30:00.425311 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 19/28] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:29:59 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1274 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:00.454235 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-ea07b91d-5be1-4ffe-855d-232715680d63 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:00.499132 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-ea07b91d-5be1-4ffe-855d-232715680d63 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:01.041499 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-ea07b91d-5be1-4ffe-855d-232715680d63 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:01.079843 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-ea07b91d-5be1-4ffe-855d-232715680d63 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:01.094784 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-ea07b91d-5be1-4ffe-855d-232715680d63 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:01.107457 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-ea07b91d-5be1-4ffe-855d-232715680d63 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1282 microversion: 2.20 time: 0.674961 Aug 31 12:30:01.111359 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 20/29] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:30:00 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1282 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:30:01.162972 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-ad193210-816d-46b5-b409-23ad1d39dcea tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:01.171242 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-ad193210-816d-46b5-b409-23ad1d39dcea tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:01.278243 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ad193210-816d-46b5-b409-23ad1d39dcea tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:01.299183 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ad193210-816d-46b5-b409-23ad1d39dcea tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:01.304617 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ad193210-816d-46b5-b409-23ad1d39dcea tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:01.306010 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ad193210-816d-46b5-b409-23ad1d39dcea tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:01.317678 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ad193210-816d-46b5-b409-23ad1d39dcea tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:01.318337 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ad193210-816d-46b5-b409-23ad1d39dcea tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:01.382483 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b307eb8f-c420-4bbc-b446-1e82ed8f8440 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:01.407748 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b307eb8f-c420-4bbc-b446-1e82ed8f8440 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1241 microversion: 2.1 time: 1.548078 Aug 31 12:30:01.415524 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 10/30] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:29:59 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1241 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:01.457473 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-dbeeadcc-53ce-4a5a-afeb-d370079fbe64 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:01.458092 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-dbeeadcc-53ce-4a5a-afeb-d370079fbe64 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:01.484866 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dbeeadcc-53ce-4a5a-afeb-d370079fbe64 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:01.486030 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dbeeadcc-53ce-4a5a-afeb-d370079fbe64 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:01.491078 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dbeeadcc-53ce-4a5a-afeb-d370079fbe64 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:01.493163 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dbeeadcc-53ce-4a5a-afeb-d370079fbe64 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:01.497341 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dbeeadcc-53ce-4a5a-afeb-d370079fbe64 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:01.497980 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dbeeadcc-53ce-4a5a-afeb-d370079fbe64 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:01.975880 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-dbeeadcc-53ce-4a5a-afeb-d370079fbe64 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:02.035115 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-dbeeadcc-53ce-4a5a-afeb-d370079fbe64 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1292 microversion: 2.1 time: 0.577218 Aug 31 12:30:02.037582 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 11/31] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:01 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1292 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:30:02.143209 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-49e34e28-fa69-4fd3-8724-a7d86cc1324a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:02.144347 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-49e34e28-fa69-4fd3-8724-a7d86cc1324a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:02.494831 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-49e34e28-fa69-4fd3-8724-a7d86cc1324a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:02.508641 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-49e34e28-fa69-4fd3-8724-a7d86cc1324a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:02.515478 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-49e34e28-fa69-4fd3-8724-a7d86cc1324a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:02.517792 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-49e34e28-fa69-4fd3-8724-a7d86cc1324a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1282 microversion: 2.20 time: 0.381708 Aug 31 12:30:02.521454 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 12/32] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:30:02 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1282 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:30:02.538682 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-dc3f99ad-7947-4416-9228-437767335bb4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:02.539396 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-dc3f99ad-7947-4416-9228-437767335bb4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:02.562462 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dc3f99ad-7947-4416-9228-437767335bb4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:02.564702 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dc3f99ad-7947-4416-9228-437767335bb4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:02.565229 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dc3f99ad-7947-4416-9228-437767335bb4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:02.565972 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dc3f99ad-7947-4416-9228-437767335bb4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:02.566448 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dc3f99ad-7947-4416-9228-437767335bb4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:02.570119 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dc3f99ad-7947-4416-9228-437767335bb4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:02.600641 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-ad193210-816d-46b5-b409-23ad1d39dcea tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:02.613888 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-ad193210-816d-46b5-b409-23ad1d39dcea tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1266 microversion: 2.1 time: 1.492462 Aug 31 12:30:02.616785 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 21/33] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:01 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1266 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:03.101054 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-8f8b6b64-776d-48ad-a899-22f89c69f563 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:03.102002 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-8f8b6b64-776d-48ad-a899-22f89c69f563 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:03.132818 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8f8b6b64-776d-48ad-a899-22f89c69f563 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:03.134369 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8f8b6b64-776d-48ad-a899-22f89c69f563 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:03.137412 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8f8b6b64-776d-48ad-a899-22f89c69f563 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:03.139026 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8f8b6b64-776d-48ad-a899-22f89c69f563 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:03.144276 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8f8b6b64-776d-48ad-a899-22f89c69f563 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:03.151708 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8f8b6b64-776d-48ad-a899-22f89c69f563 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:03.738717 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8f8b6b64-776d-48ad-a899-22f89c69f563 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:03.754118 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-8f8b6b64-776d-48ad-a899-22f89c69f563 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1280 microversion: 2.1 time: 0.674967 Aug 31 12:30:03.760988 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 22/34] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:03 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1280 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:03.776134 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-ceca6790-83b7-4468-9067-3c8346be80a5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:03.777960 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-ceca6790-83b7-4468-9067-3c8346be80a5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:03.794186 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ceca6790-83b7-4468-9067-3c8346be80a5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:03.798932 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ceca6790-83b7-4468-9067-3c8346be80a5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:03.803080 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ceca6790-83b7-4468-9067-3c8346be80a5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:03.804524 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ceca6790-83b7-4468-9067-3c8346be80a5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:03.805220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ceca6790-83b7-4468-9067-3c8346be80a5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:03.807565 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ceca6790-83b7-4468-9067-3c8346be80a5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:03.947904 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-dc3f99ad-7947-4416-9228-437767335bb4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:03.982400 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-dc3f99ad-7947-4416-9228-437767335bb4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1289 microversion: 2.1 time: 1.451148 Aug 31 12:30:03.983876 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 13/35] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:02 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1289 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:04.003694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-e183e51d-3c1c-46b3-90c3-c41465948844 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:04.016120 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-e183e51d-3c1c-46b3-90c3-c41465948844 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:04.048022 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e183e51d-3c1c-46b3-90c3-c41465948844 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:04.049009 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e183e51d-3c1c-46b3-90c3-c41465948844 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:04.049713 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e183e51d-3c1c-46b3-90c3-c41465948844 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:04.061923 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e183e51d-3c1c-46b3-90c3-c41465948844 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:04.071212 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e183e51d-3c1c-46b3-90c3-c41465948844 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:04.076308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e183e51d-3c1c-46b3-90c3-c41465948844 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:04.219225 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-ceca6790-83b7-4468-9067-3c8346be80a5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:04.254316 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-ceca6790-83b7-4468-9067-3c8346be80a5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:04.257652 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-ceca6790-83b7-4468-9067-3c8346be80a5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:04.264930 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-ceca6790-83b7-4468-9067-3c8346be80a5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1334 microversion: 2.20 time: 0.501137 Aug 31 12:30:04.270936 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 23/36] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:30:03 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1334 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:30:04.331790 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-e183e51d-3c1c-46b3-90c3-c41465948844 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:04.380049 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-e183e51d-3c1c-46b3-90c3-c41465948844 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1272 microversion: 2.1 time: 0.392821 Aug 31 12:30:04.389564 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 14/37] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:03 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1272 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:04.802963 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-5f623019-6b7b-436a-b03c-ed5d0bdfb070 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:04.803892 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-5f623019-6b7b-436a-b03c-ed5d0bdfb070 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:04.851997 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5f623019-6b7b-436a-b03c-ed5d0bdfb070 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:04.852789 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5f623019-6b7b-436a-b03c-ed5d0bdfb070 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:04.857658 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5f623019-6b7b-436a-b03c-ed5d0bdfb070 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:04.867385 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5f623019-6b7b-436a-b03c-ed5d0bdfb070 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:04.874380 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5f623019-6b7b-436a-b03c-ed5d0bdfb070 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:04.878232 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5f623019-6b7b-436a-b03c-ed5d0bdfb070 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:05.039740 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-1b3f5832-fd34-473f-8b08-6463ff3a7120 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:05.040550 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-1b3f5832-fd34-473f-8b08-6463ff3a7120 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:05.103167 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1b3f5832-fd34-473f-8b08-6463ff3a7120 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:05.108446 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1b3f5832-fd34-473f-8b08-6463ff3a7120 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:05.109262 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1b3f5832-fd34-473f-8b08-6463ff3a7120 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:05.119540 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1b3f5832-fd34-473f-8b08-6463ff3a7120 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:05.127692 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1b3f5832-fd34-473f-8b08-6463ff3a7120 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:05.132200 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1b3f5832-fd34-473f-8b08-6463ff3a7120 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:05.551244 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-1b3f5832-fd34-473f-8b08-6463ff3a7120 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:05.582439 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-1b3f5832-fd34-473f-8b08-6463ff3a7120 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1295 microversion: 2.1 time: 0.555928 Aug 31 12:30:05.588618 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 15/38] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:05 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1295 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:05.620411 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-42d1f581-8351-4d06-90a3-4d52454a0595 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:05.631379 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-42d1f581-8351-4d06-90a3-4d52454a0595 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:05.685143 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-42d1f581-8351-4d06-90a3-4d52454a0595 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:05.685143 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-42d1f581-8351-4d06-90a3-4d52454a0595 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:05.685143 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-42d1f581-8351-4d06-90a3-4d52454a0595 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:05.685143 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-42d1f581-8351-4d06-90a3-4d52454a0595 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:05.697090 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-42d1f581-8351-4d06-90a3-4d52454a0595 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:05.698003 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-42d1f581-8351-4d06-90a3-4d52454a0595 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:05.744405 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-5f623019-6b7b-436a-b03c-ed5d0bdfb070 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:05.776582 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-5f623019-6b7b-436a-b03c-ed5d0bdfb070 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1280 microversion: 2.1 time: 0.979986 Aug 31 12:30:05.780778 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 24/39] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:04 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1280 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:05.817469 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-d3e509b4-404b-4522-a689-45c09afa2b58 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:05.822096 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-d3e509b4-404b-4522-a689-45c09afa2b58 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:05.864276 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d3e509b4-404b-4522-a689-45c09afa2b58 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:05.864821 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d3e509b4-404b-4522-a689-45c09afa2b58 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:05.868140 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d3e509b4-404b-4522-a689-45c09afa2b58 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:05.869038 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d3e509b4-404b-4522-a689-45c09afa2b58 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:05.869602 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d3e509b4-404b-4522-a689-45c09afa2b58 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:05.870086 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d3e509b4-404b-4522-a689-45c09afa2b58 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:06.626209 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-d3e509b4-404b-4522-a689-45c09afa2b58 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:06.659431 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-d3e509b4-404b-4522-a689-45c09afa2b58 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1272 microversion: 2.1 time: 0.877047 Aug 31 12:30:06.660341 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 25/40] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:05 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1272 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:06.691912 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-fd03603d-66ad-43f9-bed7-c0f5535307a7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:06.694125 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-fd03603d-66ad-43f9-bed7-c0f5535307a7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:06.706034 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fd03603d-66ad-43f9-bed7-c0f5535307a7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:06.707177 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fd03603d-66ad-43f9-bed7-c0f5535307a7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:06.707917 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fd03603d-66ad-43f9-bed7-c0f5535307a7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:06.709226 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fd03603d-66ad-43f9-bed7-c0f5535307a7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:06.709992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fd03603d-66ad-43f9-bed7-c0f5535307a7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:06.710630 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fd03603d-66ad-43f9-bed7-c0f5535307a7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:07.139976 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-42d1f581-8351-4d06-90a3-4d52454a0595 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:07.164576 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=4 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:07.196817 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-42d1f581-8351-4d06-90a3-4d52454a0595 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:07.208683 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-42d1f581-8351-4d06-90a3-4d52454a0595 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:07.219720 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-42d1f581-8351-4d06-90a3-4d52454a0595 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1340 microversion: 2.20 time: 1.624463 Aug 31 12:30:07.220431 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 16/41] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:30:05 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1340 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:30:07.248024 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-c1ba9b4a-d6f8-43e1-9331-fe6fe760b22c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:07.262446 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-c1ba9b4a-d6f8-43e1-9331-fe6fe760b22c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:07.271078 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c1ba9b4a-d6f8-43e1-9331-fe6fe760b22c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:07.277124 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c1ba9b4a-d6f8-43e1-9331-fe6fe760b22c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:07.281138 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c1ba9b4a-d6f8-43e1-9331-fe6fe760b22c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:07.284219 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c1ba9b4a-d6f8-43e1-9331-fe6fe760b22c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:07.285325 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c1ba9b4a-d6f8-43e1-9331-fe6fe760b22c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:07.286357 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c1ba9b4a-d6f8-43e1-9331-fe6fe760b22c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:07.347808 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-fd03603d-66ad-43f9-bed7-c0f5535307a7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:07.373280 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-fd03603d-66ad-43f9-bed7-c0f5535307a7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1295 microversion: 2.1 time: 0.690361 Aug 31 12:30:07.389562 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 26/42] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:06 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1295 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:07.677843 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-c1ba9b4a-d6f8-43e1-9331-fe6fe760b22c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:07.718513 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-c1ba9b4a-d6f8-43e1-9331-fe6fe760b22c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1280 microversion: 2.1 time: 0.485028 Aug 31 12:30:07.736116 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 17/43] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:07 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1280 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:07.743541 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-c3d65b18-0307-44c4-8dd1-6e297bd0816f tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:07.750961 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-c3d65b18-0307-44c4-8dd1-6e297bd0816f tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:07.798319 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c3d65b18-0307-44c4-8dd1-6e297bd0816f tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:07.810448 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c3d65b18-0307-44c4-8dd1-6e297bd0816f tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:07.811667 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c3d65b18-0307-44c4-8dd1-6e297bd0816f tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:07.818131 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c3d65b18-0307-44c4-8dd1-6e297bd0816f tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:07.821785 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c3d65b18-0307-44c4-8dd1-6e297bd0816f tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:07.828132 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c3d65b18-0307-44c4-8dd1-6e297bd0816f tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:08.256867 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-07e45e58-2d85-4446-8748-292b067d5b66 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:08.258240 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-07e45e58-2d85-4446-8748-292b067d5b66 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:08.266563 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-c3d65b18-0307-44c4-8dd1-6e297bd0816f tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:08.291941 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-07e45e58-2d85-4446-8748-292b067d5b66 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:08.295811 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-07e45e58-2d85-4446-8748-292b067d5b66 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:08.296921 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-07e45e58-2d85-4446-8748-292b067d5b66 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:08.298623 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-07e45e58-2d85-4446-8748-292b067d5b66 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:08.301763 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-07e45e58-2d85-4446-8748-292b067d5b66 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:08.302799 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-07e45e58-2d85-4446-8748-292b067d5b66 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:08.329837 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-c3d65b18-0307-44c4-8dd1-6e297bd0816f tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1272 microversion: 2.1 time: 0.622395 Aug 31 12:30:08.350215 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 27/44] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:07 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1272 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:08.413481 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-260dc2b2-526b-41b5-9da1-4ff0e3fb2520 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:08.418409 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-260dc2b2-526b-41b5-9da1-4ff0e3fb2520 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:08.463252 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-260dc2b2-526b-41b5-9da1-4ff0e3fb2520 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:08.464137 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-260dc2b2-526b-41b5-9da1-4ff0e3fb2520 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:08.465747 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-260dc2b2-526b-41b5-9da1-4ff0e3fb2520 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:08.471618 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-260dc2b2-526b-41b5-9da1-4ff0e3fb2520 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:08.472579 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-260dc2b2-526b-41b5-9da1-4ff0e3fb2520 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:08.473849 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-260dc2b2-526b-41b5-9da1-4ff0e3fb2520 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:08.722233 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-260dc2b2-526b-41b5-9da1-4ff0e3fb2520 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:08.743389 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-260dc2b2-526b-41b5-9da1-4ff0e3fb2520 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1295 microversion: 2.1 time: 0.349525 Aug 31 12:30:08.752766 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 28/45] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:08 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1295 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:30:08.763362 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-195a8777-369e-470e-b0f0-f4dabcb4d882 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:08.780303 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-195a8777-369e-470e-b0f0-f4dabcb4d882 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:08.797732 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-195a8777-369e-470e-b0f0-f4dabcb4d882 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:08.799087 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-195a8777-369e-470e-b0f0-f4dabcb4d882 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:08.800069 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-195a8777-369e-470e-b0f0-f4dabcb4d882 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:08.800498 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-07e45e58-2d85-4446-8748-292b067d5b66 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:08.810229 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-195a8777-369e-470e-b0f0-f4dabcb4d882 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:08.819318 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-195a8777-369e-470e-b0f0-f4dabcb4d882 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:08.820096 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-195a8777-369e-470e-b0f0-f4dabcb4d882 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:08.844786 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-07e45e58-2d85-4446-8748-292b067d5b66 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:08.872813 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-07e45e58-2d85-4446-8748-292b067d5b66 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:08.875263 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-07e45e58-2d85-4446-8748-292b067d5b66 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1340 microversion: 2.20 time: 0.631497 Aug 31 12:30:08.878931 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 18/46] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:30:08 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1340 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:30:09.109507 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-195a8777-369e-470e-b0f0-f4dabcb4d882 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:09.150425 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-195a8777-369e-470e-b0f0-f4dabcb4d882 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1280 microversion: 2.1 time: 0.395024 Aug 31 12:30:09.154203 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 29/47] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:08 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1280 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:09.395766 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-dff064d0-b741-4f72-964b-fef8a877d537 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:09.397893 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-dff064d0-b741-4f72-964b-fef8a877d537 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:09.421287 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dff064d0-b741-4f72-964b-fef8a877d537 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:09.421833 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dff064d0-b741-4f72-964b-fef8a877d537 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:09.422298 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dff064d0-b741-4f72-964b-fef8a877d537 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:09.423079 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dff064d0-b741-4f72-964b-fef8a877d537 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:09.432601 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dff064d0-b741-4f72-964b-fef8a877d537 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:09.433153 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dff064d0-b741-4f72-964b-fef8a877d537 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:09.678520 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell0:SELECT=6 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:09.776349 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-3b456a7d-9e6a-4cc4-ad3d-411e1400620c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:09.782618 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-3b456a7d-9e6a-4cc4-ad3d-411e1400620c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:09.844742 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3b456a7d-9e6a-4cc4-ad3d-411e1400620c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:09.845350 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3b456a7d-9e6a-4cc4-ad3d-411e1400620c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:09.845809 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3b456a7d-9e6a-4cc4-ad3d-411e1400620c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:09.851091 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3b456a7d-9e6a-4cc4-ad3d-411e1400620c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:09.851771 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3b456a7d-9e6a-4cc4-ad3d-411e1400620c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:09.852231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3b456a7d-9e6a-4cc4-ad3d-411e1400620c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:09.986655 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-dff064d0-b741-4f72-964b-fef8a877d537 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:09.995452 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-dff064d0-b741-4f72-964b-fef8a877d537 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1314 microversion: 2.1 time: 0.624227 Aug 31 12:30:10.016907 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 19/48] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:09 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:10.027881 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-a282e0b3-5d95-4ba2-b743-bd2fc99d4cb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:10.028884 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-a282e0b3-5d95-4ba2-b743-bd2fc99d4cb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:10.066477 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a282e0b3-5d95-4ba2-b743-bd2fc99d4cb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:10.073579 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a282e0b3-5d95-4ba2-b743-bd2fc99d4cb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:10.074837 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a282e0b3-5d95-4ba2-b743-bd2fc99d4cb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:10.080961 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a282e0b3-5d95-4ba2-b743-bd2fc99d4cb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:10.083678 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a282e0b3-5d95-4ba2-b743-bd2fc99d4cb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:10.084503 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a282e0b3-5d95-4ba2-b743-bd2fc99d4cb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:10.241914 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-3b456a7d-9e6a-4cc4-ad3d-411e1400620c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:10.257730 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-3b456a7d-9e6a-4cc4-ad3d-411e1400620c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1362 microversion: 2.1 time: 0.491751 Aug 31 12:30:10.260731 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 30/49] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:09 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1362 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:10.275098 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-cbbab97f-94e4-47c6-ab3b-a3f3d737bb37 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:10.281689 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-cbbab97f-94e4-47c6-ab3b-a3f3d737bb37 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:10.296279 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cbbab97f-94e4-47c6-ab3b-a3f3d737bb37 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:10.299963 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cbbab97f-94e4-47c6-ab3b-a3f3d737bb37 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:10.302236 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cbbab97f-94e4-47c6-ab3b-a3f3d737bb37 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:10.303627 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cbbab97f-94e4-47c6-ab3b-a3f3d737bb37 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:10.306195 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-a282e0b3-5d95-4ba2-b743-bd2fc99d4cb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:10.307758 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cbbab97f-94e4-47c6-ab3b-a3f3d737bb37 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:10.309956 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cbbab97f-94e4-47c6-ab3b-a3f3d737bb37 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:10.337982 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-a282e0b3-5d95-4ba2-b743-bd2fc99d4cb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:10.343997 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-a282e0b3-5d95-4ba2-b743-bd2fc99d4cb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:10.349245 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-a282e0b3-5d95-4ba2-b743-bd2fc99d4cb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1340 microversion: 2.20 time: 0.329984 Aug 31 12:30:10.363734 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 20/50] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:30:10 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1340 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:30:10.693175 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-cbbab97f-94e4-47c6-ab3b-a3f3d737bb37 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:10.710817 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-cbbab97f-94e4-47c6-ab3b-a3f3d737bb37 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1322 microversion: 2.1 time: 0.445116 Aug 31 12:30:10.724701 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 31/51] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:10 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1322 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:11.044985 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-fafe3f29-9ed4-4f19-8d2a-e94ea97b182d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:11.047172 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-fafe3f29-9ed4-4f19-8d2a-e94ea97b182d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:11.087359 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fafe3f29-9ed4-4f19-8d2a-e94ea97b182d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:11.088871 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fafe3f29-9ed4-4f19-8d2a-e94ea97b182d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:11.094536 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fafe3f29-9ed4-4f19-8d2a-e94ea97b182d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:11.098570 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fafe3f29-9ed4-4f19-8d2a-e94ea97b182d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:11.102287 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fafe3f29-9ed4-4f19-8d2a-e94ea97b182d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:11.106426 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fafe3f29-9ed4-4f19-8d2a-e94ea97b182d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:11.299312 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-6049b02c-a954-49ac-800c-9f33975e9203 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:11.299919 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-6049b02c-a954-49ac-800c-9f33975e9203 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:11.301906 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=26 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:11.323548 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6049b02c-a954-49ac-800c-9f33975e9203 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:11.323548 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6049b02c-a954-49ac-800c-9f33975e9203 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:11.331834 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6049b02c-a954-49ac-800c-9f33975e9203 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:11.332650 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6049b02c-a954-49ac-800c-9f33975e9203 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:11.341146 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6049b02c-a954-49ac-800c-9f33975e9203 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:11.345075 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6049b02c-a954-49ac-800c-9f33975e9203 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:11.477724 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-fafe3f29-9ed4-4f19-8d2a-e94ea97b182d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:11.544276 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-fafe3f29-9ed4-4f19-8d2a-e94ea97b182d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1314 microversion: 2.1 time: 0.500143 Aug 31 12:30:11.550316 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 21/52] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:11 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:11.581360 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-860e4d31-e78b-4215-9545-90588c86a717 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:11.607977 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-860e4d31-e78b-4215-9545-90588c86a717 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:11.652854 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-860e4d31-e78b-4215-9545-90588c86a717 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:11.661784 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-860e4d31-e78b-4215-9545-90588c86a717 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:11.665238 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-860e4d31-e78b-4215-9545-90588c86a717 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:11.668912 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-860e4d31-e78b-4215-9545-90588c86a717 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:11.669976 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-860e4d31-e78b-4215-9545-90588c86a717 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:11.673012 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-860e4d31-e78b-4215-9545-90588c86a717 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:11.815222 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-6049b02c-a954-49ac-800c-9f33975e9203 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:11.875868 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-6049b02c-a954-49ac-800c-9f33975e9203 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1362 microversion: 2.1 time: 0.564915 Aug 31 12:30:11.906665 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 32/53] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:11 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1362 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:11.947355 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-8988f75e-254b-40c2-927d-2e8adb1e8146 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:11.951219 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-8988f75e-254b-40c2-927d-2e8adb1e8146 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:11.988511 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:12.016076 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8988f75e-254b-40c2-927d-2e8adb1e8146 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:12.016815 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8988f75e-254b-40c2-927d-2e8adb1e8146 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:12.017576 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8988f75e-254b-40c2-927d-2e8adb1e8146 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:12.035915 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8988f75e-254b-40c2-927d-2e8adb1e8146 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:12.036746 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8988f75e-254b-40c2-927d-2e8adb1e8146 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:12.037505 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8988f75e-254b-40c2-927d-2e8adb1e8146 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:12.287289 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-860e4d31-e78b-4215-9545-90588c86a717 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:12.314836 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-860e4d31-e78b-4215-9545-90588c86a717 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:12.321600 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-860e4d31-e78b-4215-9545-90588c86a717 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:12.328347 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-860e4d31-e78b-4215-9545-90588c86a717 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1340 microversion: 2.20 time: 0.776006 Aug 31 12:30:12.333502 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 22/54] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:30:11 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1340 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:30:12.569724 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-0958827f-bfd9-4a7e-80a6-56b2b5610c88 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:12.570660 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-0958827f-bfd9-4a7e-80a6-56b2b5610c88 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:12.582682 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell0:SELECT=24 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:12.597174 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0958827f-bfd9-4a7e-80a6-56b2b5610c88 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:12.598225 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0958827f-bfd9-4a7e-80a6-56b2b5610c88 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:12.600095 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0958827f-bfd9-4a7e-80a6-56b2b5610c88 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:12.601482 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0958827f-bfd9-4a7e-80a6-56b2b5610c88 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:12.603359 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0958827f-bfd9-4a7e-80a6-56b2b5610c88 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:12.606246 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0958827f-bfd9-4a7e-80a6-56b2b5610c88 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:12.840812 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8988f75e-254b-40c2-927d-2e8adb1e8146 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:12.869718 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-8988f75e-254b-40c2-927d-2e8adb1e8146 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1322 microversion: 2.1 time: 0.957550 Aug 31 12:30:12.870426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 33/55] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:11 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1322 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:12.914039 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-1f18a23f-04ae-4014-b63a-9ec75f13a9d2 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:12.915155 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-1f18a23f-04ae-4014-b63a-9ec75f13a9d2 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:12.930303 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1f18a23f-04ae-4014-b63a-9ec75f13a9d2 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:12.935601 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1f18a23f-04ae-4014-b63a-9ec75f13a9d2 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:12.939682 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1f18a23f-04ae-4014-b63a-9ec75f13a9d2 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:12.945351 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1f18a23f-04ae-4014-b63a-9ec75f13a9d2 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:12.948829 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1f18a23f-04ae-4014-b63a-9ec75f13a9d2 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:12.951582 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1f18a23f-04ae-4014-b63a-9ec75f13a9d2 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:13.757715 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-0958827f-bfd9-4a7e-80a6-56b2b5610c88 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:13.774031 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-0958827f-bfd9-4a7e-80a6-56b2b5610c88 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1314 microversion: 2.1 time: 1.205769 Aug 31 12:30:13.779001 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 23/56] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:12 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1314 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:13.804711 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b5f922fc-6d64-4068-942c-b77509bab09c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:13.812854 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-b5f922fc-6d64-4068-942c-b77509bab09c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:13.831354 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b5f922fc-6d64-4068-942c-b77509bab09c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:13.837683 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b5f922fc-6d64-4068-942c-b77509bab09c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:13.844433 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b5f922fc-6d64-4068-942c-b77509bab09c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:13.849432 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b5f922fc-6d64-4068-942c-b77509bab09c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:13.853003 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b5f922fc-6d64-4068-942c-b77509bab09c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:13.858532 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b5f922fc-6d64-4068-942c-b77509bab09c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:14.234890 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-1f18a23f-04ae-4014-b63a-9ec75f13a9d2 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:14.242770 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=100 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:14.284572 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-1f18a23f-04ae-4014-b63a-9ec75f13a9d2 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1362 microversion: 2.1 time: 1.374280 Aug 31 12:30:14.287863 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 34/57] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:12 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1362 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:30:14.339231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-b723f5b2-a33c-45df-a3fc-fdff0b14e7f9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:14.339231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-b723f5b2-a33c-45df-a3fc-fdff0b14e7f9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:14.361904 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b723f5b2-a33c-45df-a3fc-fdff0b14e7f9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:14.364325 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b723f5b2-a33c-45df-a3fc-fdff0b14e7f9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:14.367582 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b723f5b2-a33c-45df-a3fc-fdff0b14e7f9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:14.376556 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b723f5b2-a33c-45df-a3fc-fdff0b14e7f9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:14.380485 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b723f5b2-a33c-45df-a3fc-fdff0b14e7f9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:14.381757 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b723f5b2-a33c-45df-a3fc-fdff0b14e7f9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:14.533634 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b5f922fc-6d64-4068-942c-b77509bab09c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:14.600382 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b5f922fc-6d64-4068-942c-b77509bab09c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:14.619313 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b5f922fc-6d64-4068-942c-b77509bab09c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:14.628405 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b5f922fc-6d64-4068-942c-b77509bab09c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1340 microversion: 2.20 time: 0.845161 Aug 31 12:30:14.646899 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 24/58] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:30:13 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1340 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:30:14.815197 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-9608ebc8-1778-48a3-9955-f40aaa8decde tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:14.816202 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-9608ebc8-1778-48a3-9955-f40aaa8decde tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:14.831723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9608ebc8-1778-48a3-9955-f40aaa8decde tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:14.832127 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9608ebc8-1778-48a3-9955-f40aaa8decde tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:14.832558 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9608ebc8-1778-48a3-9955-f40aaa8decde tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:14.836647 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9608ebc8-1778-48a3-9955-f40aaa8decde tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:14.837139 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9608ebc8-1778-48a3-9955-f40aaa8decde tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:14.837574 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9608ebc8-1778-48a3-9955-f40aaa8decde tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:15.202102 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-b723f5b2-a33c-45df-a3fc-fdff0b14e7f9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:15.241353 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-b723f5b2-a33c-45df-a3fc-fdff0b14e7f9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1322 microversion: 2.1 time: 0.945140 Aug 31 12:30:15.242566 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 35/59] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:14 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1322 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:15.342426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-50daf8f2-e69f-49cf-b6d6-b790ff6fbdca tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:15.350784 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-50daf8f2-e69f-49cf-b6d6-b790ff6fbdca tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:15.372103 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-50daf8f2-e69f-49cf-b6d6-b790ff6fbdca tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:15.379298 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-50daf8f2-e69f-49cf-b6d6-b790ff6fbdca tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:15.380579 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-50daf8f2-e69f-49cf-b6d6-b790ff6fbdca tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:15.381925 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-50daf8f2-e69f-49cf-b6d6-b790ff6fbdca tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:15.385927 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-50daf8f2-e69f-49cf-b6d6-b790ff6fbdca tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:15.391331 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-50daf8f2-e69f-49cf-b6d6-b790ff6fbdca tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:15.473500 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-9608ebc8-1778-48a3-9955-f40aaa8decde tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:15.488023 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-9608ebc8-1778-48a3-9955-f40aaa8decde tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1314 microversion: 2.1 time: 0.687712 Aug 31 12:30:15.497521 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 25/60] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:14 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1314 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:15.691970 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-3bc45a14-9970-489d-b582-2ea6419ba3bf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:15.695387 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-3bc45a14-9970-489d-b582-2ea6419ba3bf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:15.736277 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3bc45a14-9970-489d-b582-2ea6419ba3bf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:15.741703 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3bc45a14-9970-489d-b582-2ea6419ba3bf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:15.744177 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3bc45a14-9970-489d-b582-2ea6419ba3bf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:15.745998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3bc45a14-9970-489d-b582-2ea6419ba3bf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:15.751322 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3bc45a14-9970-489d-b582-2ea6419ba3bf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:15.756320 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3bc45a14-9970-489d-b582-2ea6419ba3bf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:15.967562 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=100 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:16.315386 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-50daf8f2-e69f-49cf-b6d6-b790ff6fbdca tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:16.336899 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-50daf8f2-e69f-49cf-b6d6-b790ff6fbdca tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1362 microversion: 2.1 time: 1.001466 Aug 31 12:30:16.337894 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 36/61] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:15 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1362 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:16.348228 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-2b5bd444-23b5-4b91-9fbf-3d26fe7ae8b4 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:16.348976 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-2b5bd444-23b5-4b91-9fbf-3d26fe7ae8b4 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:16.372567 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2b5bd444-23b5-4b91-9fbf-3d26fe7ae8b4 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:16.375527 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2b5bd444-23b5-4b91-9fbf-3d26fe7ae8b4 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:16.379078 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2b5bd444-23b5-4b91-9fbf-3d26fe7ae8b4 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:16.388642 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2b5bd444-23b5-4b91-9fbf-3d26fe7ae8b4 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:16.389619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2b5bd444-23b5-4b91-9fbf-3d26fe7ae8b4 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:16.400780 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2b5bd444-23b5-4b91-9fbf-3d26fe7ae8b4 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:16.894329 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-3bc45a14-9970-489d-b582-2ea6419ba3bf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:16.959702 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-3bc45a14-9970-489d-b582-2ea6419ba3bf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:16.969066 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-3bc45a14-9970-489d-b582-2ea6419ba3bf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:16.973567 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-3bc45a14-9970-489d-b582-2ea6419ba3bf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1340 microversion: 2.20 time: 1.294229 Aug 31 12:30:16.993154 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 26/62] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:30:15 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1340 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:30:17.033729 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-795bb63f-a375-4f26-a3b4-4f4948e462e9 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:17.034950 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-795bb63f-a375-4f26-a3b4-4f4948e462e9 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:17.057666 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-795bb63f-a375-4f26-a3b4-4f4948e462e9 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:17.060703 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-795bb63f-a375-4f26-a3b4-4f4948e462e9 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:17.066041 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-795bb63f-a375-4f26-a3b4-4f4948e462e9 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:17.075311 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-795bb63f-a375-4f26-a3b4-4f4948e462e9 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:17.087784 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-795bb63f-a375-4f26-a3b4-4f4948e462e9 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:17.088803 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-795bb63f-a375-4f26-a3b4-4f4948e462e9 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:17.724210 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-2b5bd444-23b5-4b91-9fbf-3d26fe7ae8b4 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:17.756939 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-2b5bd444-23b5-4b91-9fbf-3d26fe7ae8b4 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1322 microversion: 2.1 time: 1.417722 Aug 31 12:30:17.780894 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 37/63] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:16 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1322 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:17.837327 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-2831aef6-b6ac-4313-8ea2-a2bb9def108e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:17.863742 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-2831aef6-b6ac-4313-8ea2-a2bb9def108e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:17.884282 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2831aef6-b6ac-4313-8ea2-a2bb9def108e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:17.885869 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2831aef6-b6ac-4313-8ea2-a2bb9def108e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:17.887780 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2831aef6-b6ac-4313-8ea2-a2bb9def108e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:17.889866 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2831aef6-b6ac-4313-8ea2-a2bb9def108e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:17.892189 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2831aef6-b6ac-4313-8ea2-a2bb9def108e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:17.893681 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2831aef6-b6ac-4313-8ea2-a2bb9def108e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:18.136646 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-795bb63f-a375-4f26-a3b4-4f4948e462e9 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:18.148707 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-795bb63f-a375-4f26-a3b4-4f4948e462e9 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1314 microversion: 2.1 time: 1.147081 Aug 31 12:30:18.176893 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 27/64] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:16 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1314 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:18.192175 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-6de295f1-f5de-4c64-bba7-d45a1498f600 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:18.193083 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-6de295f1-f5de-4c64-bba7-d45a1498f600 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:18.221913 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6de295f1-f5de-4c64-bba7-d45a1498f600 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:18.222456 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6de295f1-f5de-4c64-bba7-d45a1498f600 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:18.226230 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6de295f1-f5de-4c64-bba7-d45a1498f600 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:18.227242 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6de295f1-f5de-4c64-bba7-d45a1498f600 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:18.228697 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6de295f1-f5de-4c64-bba7-d45a1498f600 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:18.232918 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6de295f1-f5de-4c64-bba7-d45a1498f600 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:18.600140 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-2831aef6-b6ac-4313-8ea2-a2bb9def108e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:18.619076 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-2831aef6-b6ac-4313-8ea2-a2bb9def108e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1362 microversion: 2.1 time: 0.830060 Aug 31 12:30:18.629800 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 38/65] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:17 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1362 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:18.789215 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-4ff6bf77-d27b-4baf-9095-dcbb616bd05e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:18.791231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-4ff6bf77-d27b-4baf-9095-dcbb616bd05e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:18.806830 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4ff6bf77-d27b-4baf-9095-dcbb616bd05e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:18.807597 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4ff6bf77-d27b-4baf-9095-dcbb616bd05e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:18.808138 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4ff6bf77-d27b-4baf-9095-dcbb616bd05e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:18.809763 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4ff6bf77-d27b-4baf-9095-dcbb616bd05e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:18.810251 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4ff6bf77-d27b-4baf-9095-dcbb616bd05e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:18.810823 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4ff6bf77-d27b-4baf-9095-dcbb616bd05e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:20.124963 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-4ff6bf77-d27b-4baf-9095-dcbb616bd05e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:20.170565 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-4ff6bf77-d27b-4baf-9095-dcbb616bd05e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1322 microversion: 2.1 time: 1.385696 Aug 31 12:30:20.176010 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 39/66] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:18 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1322 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:30:20.196721 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-7db84727-46e8-4578-8e72-6cdc4e145fda tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:20.200923 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-7db84727-46e8-4578-8e72-6cdc4e145fda tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:20.221603 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7db84727-46e8-4578-8e72-6cdc4e145fda tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:20.223194 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7db84727-46e8-4578-8e72-6cdc4e145fda tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:20.224496 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7db84727-46e8-4578-8e72-6cdc4e145fda tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:20.225705 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7db84727-46e8-4578-8e72-6cdc4e145fda tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:20.226416 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7db84727-46e8-4578-8e72-6cdc4e145fda tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:20.227023 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7db84727-46e8-4578-8e72-6cdc4e145fda tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:20.318833 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-6de295f1-f5de-4c64-bba7-d45a1498f600 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:20.335401 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-6de295f1-f5de-4c64-bba7-d45a1498f600 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:20.343126 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-6de295f1-f5de-4c64-bba7-d45a1498f600 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:20.348333 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-6de295f1-f5de-4c64-bba7-d45a1498f600 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1408 microversion: 2.20 time: 2.166928 Aug 31 12:30:20.350513 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 28/67] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:30:18 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1408 bytes in 2173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:30:20.789925 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-f036cda0-8d31-49b1-9b6e-a6ffb2a00943 req-a3c6e2ed-eead-40fa-8357-6ba2b6743e99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72fc3ffa-e316-44ad-8bd1-9767a06cf3ba", "tag": "41eb7341-e106-4e13-a267-482be8b20f73"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:30:20.872982 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:20.881988 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-f036cda0-8d31-49b1-9b6e-a6ffb2a00943 req-a3c6e2ed-eead-40fa-8357-6ba2b6743e99 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:20.885288 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-f036cda0-8d31-49b1-9b6e-a6ffb2a00943 req-a3c6e2ed-eead-40fa-8357-6ba2b6743e99 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:20.888258 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-f036cda0-8d31-49b1-9b6e-a6ffb2a00943 req-a3c6e2ed-eead-40fa-8357-6ba2b6743e99 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:21.002556 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-7db84727-46e8-4578-8e72-6cdc4e145fda tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:21.011366 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-7db84727-46e8-4578-8e72-6cdc4e145fda tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1314 microversion: 2.1 time: 0.832696 Aug 31 12:30:21.012237 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 40/68] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:20 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1314 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:21.026308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-f036cda0-8d31-49b1-9b6e-a6ffb2a00943 req-a3c6e2ed-eead-40fa-8357-6ba2b6743e99 service nova] Creating event network-changed:41eb7341-e106-4e13-a267-482be8b20f73 for instance 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba on hv-cinder-85528 Aug 31 12:30:21.026308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-f036cda0-8d31-49b1-9b6e-a6ffb2a00943 req-a3c6e2ed-eead-40fa-8357-6ba2b6743e99 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120750) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 12:30:21.027960 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-f036cda0-8d31-49b1-9b6e-a6ffb2a00943 req-a3c6e2ed-eead-40fa-8357-6ba2b6743e99 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120750) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 12:30:21.030115 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-69a32b73-b872-43d1-8ed5-9730b775c3c5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:21.030324 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-a3f38ef2-b94d-42f3-b441-3923871f5604 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:21.030981 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-69a32b73-b872-43d1-8ed5-9730b775c3c5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:21.031562 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-a3f38ef2-b94d-42f3-b441-3923871f5604 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:21.039035 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a3f38ef2-b94d-42f3-b441-3923871f5604 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:21.040132 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a3f38ef2-b94d-42f3-b441-3923871f5604 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:21.041007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a3f38ef2-b94d-42f3-b441-3923871f5604 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:21.041954 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a3f38ef2-b94d-42f3-b441-3923871f5604 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:21.043792 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a3f38ef2-b94d-42f3-b441-3923871f5604 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:21.047887 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a3f38ef2-b94d-42f3-b441-3923871f5604 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:21.050359 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-69a32b73-b872-43d1-8ed5-9730b775c3c5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:21.055014 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-69a32b73-b872-43d1-8ed5-9730b775c3c5 None None] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:21.056392 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-69a32b73-b872-43d1-8ed5-9730b775c3c5 None None] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:21.058823 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-69a32b73-b872-43d1-8ed5-9730b775c3c5 None None] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:21.082472 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.compute.rpcapi [None req-69a32b73-b872-43d1-8ed5-9730b775c3c5 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 12:30:21.093039 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-69a32b73-b872-43d1-8ed5-9730b775c3c5 None None] Releasing lock "compute-rpcapi-router" {{(pid=120750) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 12:30:21.168315 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-69a32b73-b872-43d1-8ed5-9730b775c3c5 None None] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.814800 Aug 31 12:30:21.187842 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 29/69] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:21.557855 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-46012d88-d5c0-4c68-9f9c-0382472637d1 req-f8b2f9e1-f4db-40f2-ab5d-f4cbd52b9db8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbae24ec-b404-415c-97a7-a78cd28ff068", "tag": "beb6c22d-2e33-4df9-bc8d-b813944abaf7"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:30:21.604835 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-a3f38ef2-b94d-42f3-b441-3923871f5604 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:21.619266 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-a3f38ef2-b94d-42f3-b441-3923871f5604 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1362 microversion: 2.1 time: 0.588530 Aug 31 12:30:21.620700 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 41/70] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:21 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1362 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:21.630053 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-deaf7812-55fd-4624-a737-837e3fcc9790 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:21.633214 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-deaf7812-55fd-4624-a737-837e3fcc9790 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:21.645796 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-deaf7812-55fd-4624-a737-837e3fcc9790 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:21.646613 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-deaf7812-55fd-4624-a737-837e3fcc9790 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:21.647524 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-deaf7812-55fd-4624-a737-837e3fcc9790 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:21.648504 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-deaf7812-55fd-4624-a737-837e3fcc9790 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:21.649260 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-deaf7812-55fd-4624-a737-837e3fcc9790 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:21.649992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-deaf7812-55fd-4624-a737-837e3fcc9790 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:21.685648 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-46012d88-d5c0-4c68-9f9c-0382472637d1 req-f8b2f9e1-f4db-40f2-ab5d-f4cbd52b9db8 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:21.687689 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-46012d88-d5c0-4c68-9f9c-0382472637d1 req-f8b2f9e1-f4db-40f2-ab5d-f4cbd52b9db8 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:21.688932 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-46012d88-d5c0-4c68-9f9c-0382472637d1 req-f8b2f9e1-f4db-40f2-ab5d-f4cbd52b9db8 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:21.734456 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-46012d88-d5c0-4c68-9f9c-0382472637d1 req-f8b2f9e1-f4db-40f2-ab5d-f4cbd52b9db8 service nova] Creating event network-changed:beb6c22d-2e33-4df9-bc8d-b813944abaf7 for instance bbae24ec-b404-415c-97a7-a78cd28ff068 on hv-cinder-85528 Aug 31 12:30:21.760020 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-46012d88-d5c0-4c68-9f9c-0382472637d1 req-f8b2f9e1-f4db-40f2-ab5d-f4cbd52b9db8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.560095 Aug 31 12:30:21.765261 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 30/71] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:21.777166 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-f5a0357c-885f-48d2-8195-250b70605e73 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:21.788325 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-f5a0357c-885f-48d2-8195-250b70605e73 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:21.868968 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f5a0357c-885f-48d2-8195-250b70605e73 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:21.871537 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f5a0357c-885f-48d2-8195-250b70605e73 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:21.872627 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f5a0357c-885f-48d2-8195-250b70605e73 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:21.891181 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f5a0357c-885f-48d2-8195-250b70605e73 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:21.892576 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f5a0357c-885f-48d2-8195-250b70605e73 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:21.896568 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f5a0357c-885f-48d2-8195-250b70605e73 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:22.426960 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-deaf7812-55fd-4624-a737-837e3fcc9790 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:22.479219 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-deaf7812-55fd-4624-a737-837e3fcc9790 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1322 microversion: 2.1 time: 0.856065 Aug 31 12:30:22.488740 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 42/72] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:21 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1322 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:22.495086 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-cb858879-66d0-4f39-95aa-5d97a6d56a47 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:22.497476 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-cb858879-66d0-4f39-95aa-5d97a6d56a47 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:22.506909 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cb858879-66d0-4f39-95aa-5d97a6d56a47 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:22.507913 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cb858879-66d0-4f39-95aa-5d97a6d56a47 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:22.509018 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cb858879-66d0-4f39-95aa-5d97a6d56a47 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:22.512354 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cb858879-66d0-4f39-95aa-5d97a6d56a47 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:22.514799 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cb858879-66d0-4f39-95aa-5d97a6d56a47 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:22.515996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cb858879-66d0-4f39-95aa-5d97a6d56a47 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:22.983845 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-cb858879-66d0-4f39-95aa-5d97a6d56a47 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:23.000261 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-cb858879-66d0-4f39-95aa-5d97a6d56a47 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1314 microversion: 2.1 time: 0.509321 Aug 31 12:30:23.016946 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 43/73] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:22 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:23.039431 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-68a704bd-802c-4a31-8d76-d2ee16a1fa96 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:23.048389 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-68a704bd-802c-4a31-8d76-d2ee16a1fa96 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:23.063210 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-68a704bd-802c-4a31-8d76-d2ee16a1fa96 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:23.070030 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-68a704bd-802c-4a31-8d76-d2ee16a1fa96 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:23.071041 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-68a704bd-802c-4a31-8d76-d2ee16a1fa96 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:23.072031 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-68a704bd-802c-4a31-8d76-d2ee16a1fa96 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:23.073000 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-68a704bd-802c-4a31-8d76-d2ee16a1fa96 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:23.074376 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-68a704bd-802c-4a31-8d76-d2ee16a1fa96 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:23.538727 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-68a704bd-802c-4a31-8d76-d2ee16a1fa96 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:23.552379 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-68a704bd-802c-4a31-8d76-d2ee16a1fa96 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1362 microversion: 2.1 time: 0.534188 Aug 31 12:30:23.555679 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 44/74] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:23 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1362 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:23.578452 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-ed230712-6df4-46a2-830a-a3f04924e3d8 req-120f9b7e-d474-4b70-afbe-155aa370a472 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3490a556-866f-470d-953a-dab05d45e9e6", "tag": "0a707636-801a-41c6-8d9a-d69739984b5b"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:30:23.604312 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-ed230712-6df4-46a2-830a-a3f04924e3d8 req-120f9b7e-d474-4b70-afbe-155aa370a472 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:23.605211 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-ed230712-6df4-46a2-830a-a3f04924e3d8 req-120f9b7e-d474-4b70-afbe-155aa370a472 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:23.605800 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-ed230712-6df4-46a2-830a-a3f04924e3d8 req-120f9b7e-d474-4b70-afbe-155aa370a472 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:23.646746 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-ed230712-6df4-46a2-830a-a3f04924e3d8 req-120f9b7e-d474-4b70-afbe-155aa370a472 service nova] Creating event network-changed:0a707636-801a-41c6-8d9a-d69739984b5b for instance 3490a556-866f-470d-953a-dab05d45e9e6 on hv-cinder-85528 Aug 31 12:30:23.647892 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-ed230712-6df4-46a2-830a-a3f04924e3d8 req-120f9b7e-d474-4b70-afbe-155aa370a472 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120749) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 12:30:23.654220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-ed230712-6df4-46a2-830a-a3f04924e3d8 req-120f9b7e-d474-4b70-afbe-155aa370a472 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120749) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 12:30:23.660367 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-59fdb548-4bf2-4996-a671-7e6d85dd17f8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:23.661145 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-59fdb548-4bf2-4996-a671-7e6d85dd17f8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:23.664695 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-59fdb548-4bf2-4996-a671-7e6d85dd17f8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:23.666095 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-59fdb548-4bf2-4996-a671-7e6d85dd17f8 None None] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:23.671001 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-59fdb548-4bf2-4996-a671-7e6d85dd17f8 None None] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:23.673691 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-59fdb548-4bf2-4996-a671-7e6d85dd17f8 None None] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:23.717182 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.compute.rpcapi [None req-59fdb548-4bf2-4996-a671-7e6d85dd17f8 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 12:30:23.718401 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-59fdb548-4bf2-4996-a671-7e6d85dd17f8 None None] Releasing lock "compute-rpcapi-router" {{(pid=120749) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 12:30:23.765182 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-59fdb548-4bf2-4996-a671-7e6d85dd17f8 None None] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.206828 Aug 31 12:30:23.768504 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 45/75] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:23.777829 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-9e7dfe0a-7652-4bfb-aa4d-804ab9eda06c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:23.779283 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-9e7dfe0a-7652-4bfb-aa4d-804ab9eda06c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:23.793142 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9e7dfe0a-7652-4bfb-aa4d-804ab9eda06c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:23.794525 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9e7dfe0a-7652-4bfb-aa4d-804ab9eda06c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:23.795531 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9e7dfe0a-7652-4bfb-aa4d-804ab9eda06c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:23.797155 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9e7dfe0a-7652-4bfb-aa4d-804ab9eda06c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:23.798144 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9e7dfe0a-7652-4bfb-aa4d-804ab9eda06c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:23.799168 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9e7dfe0a-7652-4bfb-aa4d-804ab9eda06c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:24.131673 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f5a0357c-885f-48d2-8195-250b70605e73 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:24.157631 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f5a0357c-885f-48d2-8195-250b70605e73 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:24.163481 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f5a0357c-885f-48d2-8195-250b70605e73 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:24.165514 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-f5a0357c-885f-48d2-8195-250b70605e73 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1408 microversion: 2.20 time: 2.397259 Aug 31 12:30:24.166487 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 31/76] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:30:21 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1408 bytes in 2400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:30:24.197590 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-1455995c-8303-4bbe-916e-f13b10d1bb1e req-b082d89d-8b96-4c60-b674-18472a4e3d4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59de5135-bc13-4ecc-a3b9-015b32aec285", "tag": "989a01eb-9f16-4e0f-b023-10a0ee6b8e11"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:30:24.237111 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-1455995c-8303-4bbe-916e-f13b10d1bb1e req-b082d89d-8b96-4c60-b674-18472a4e3d4b service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:24.237755 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-1455995c-8303-4bbe-916e-f13b10d1bb1e req-b082d89d-8b96-4c60-b674-18472a4e3d4b service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:24.238275 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-1455995c-8303-4bbe-916e-f13b10d1bb1e req-b082d89d-8b96-4c60-b674-18472a4e3d4b service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:24.269144 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-1455995c-8303-4bbe-916e-f13b10d1bb1e req-b082d89d-8b96-4c60-b674-18472a4e3d4b service nova] Creating event network-changed:989a01eb-9f16-4e0f-b023-10a0ee6b8e11 for instance 59de5135-bc13-4ecc-a3b9-015b32aec285 on hv-cinder-85528 Aug 31 12:30:24.281785 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-1455995c-8303-4bbe-916e-f13b10d1bb1e req-b082d89d-8b96-4c60-b674-18472a4e3d4b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113554 Aug 31 12:30:24.282559 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 32/77] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:24.288810 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-7331dd9f-d812-42c4-901b-a3f3b956cfaa tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:24.289867 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-7331dd9f-d812-42c4-901b-a3f3b956cfaa tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:24.298513 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7331dd9f-d812-42c4-901b-a3f3b956cfaa tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:24.299277 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7331dd9f-d812-42c4-901b-a3f3b956cfaa tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:24.299932 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7331dd9f-d812-42c4-901b-a3f3b956cfaa tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:24.301055 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7331dd9f-d812-42c4-901b-a3f3b956cfaa tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:24.301983 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7331dd9f-d812-42c4-901b-a3f3b956cfaa tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:24.302649 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7331dd9f-d812-42c4-901b-a3f3b956cfaa tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:24.690657 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-9e7dfe0a-7652-4bfb-aa4d-804ab9eda06c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:24.706596 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-9e7dfe0a-7652-4bfb-aa4d-804ab9eda06c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1322 microversion: 2.1 time: 0.936056 Aug 31 12:30:24.707224 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 46/78] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:23 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1322 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:24.718017 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-253b2794-ed25-4225-b716-4e5074efe616 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:24.720179 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-253b2794-ed25-4225-b716-4e5074efe616 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:24.735104 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-253b2794-ed25-4225-b716-4e5074efe616 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:24.738675 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-253b2794-ed25-4225-b716-4e5074efe616 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:24.739603 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-253b2794-ed25-4225-b716-4e5074efe616 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:24.740349 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-253b2794-ed25-4225-b716-4e5074efe616 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:24.742712 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-253b2794-ed25-4225-b716-4e5074efe616 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:24.744441 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-253b2794-ed25-4225-b716-4e5074efe616 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:24.841210 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-7331dd9f-d812-42c4-901b-a3f3b956cfaa tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:24.870244 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-7331dd9f-d812-42c4-901b-a3f3b956cfaa tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1314 microversion: 2.1 time: 0.585544 Aug 31 12:30:24.873762 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 33/79] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:24 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1314 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:25.158051 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-253b2794-ed25-4225-b716-4e5074efe616 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:25.167421 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-253b2794-ed25-4225-b716-4e5074efe616 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1362 microversion: 2.1 time: 0.456101 Aug 31 12:30:25.171411 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 47/80] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:24 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1362 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:25.191160 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-586a15fd-dfa0-460f-ba37-8c95c5a6f1b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:25.191766 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-586a15fd-dfa0-460f-ba37-8c95c5a6f1b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:25.201211 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-586a15fd-dfa0-460f-ba37-8c95c5a6f1b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:25.201713 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-586a15fd-dfa0-460f-ba37-8c95c5a6f1b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:25.202175 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-586a15fd-dfa0-460f-ba37-8c95c5a6f1b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:25.207143 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-586a15fd-dfa0-460f-ba37-8c95c5a6f1b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:25.207851 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-586a15fd-dfa0-460f-ba37-8c95c5a6f1b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:25.208299 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-586a15fd-dfa0-460f-ba37-8c95c5a6f1b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:25.460738 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-586a15fd-dfa0-460f-ba37-8c95c5a6f1b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:25.471046 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-586a15fd-dfa0-460f-ba37-8c95c5a6f1b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:25.472767 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-586a15fd-dfa0-460f-ba37-8c95c5a6f1b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:25.473921 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-586a15fd-dfa0-460f-ba37-8c95c5a6f1b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1408 microversion: 2.20 time: 0.286917 Aug 31 12:30:25.475108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 34/81] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:30:25 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1408 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:30:25.731988 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-cf4aad92-618a-41c8-9845-47009db9a2de tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:25.733287 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-cf4aad92-618a-41c8-9845-47009db9a2de tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:25.740703 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cf4aad92-618a-41c8-9845-47009db9a2de tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:25.741381 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cf4aad92-618a-41c8-9845-47009db9a2de tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:25.741993 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cf4aad92-618a-41c8-9845-47009db9a2de tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:25.742923 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cf4aad92-618a-41c8-9845-47009db9a2de tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:25.743556 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cf4aad92-618a-41c8-9845-47009db9a2de tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:25.743979 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cf4aad92-618a-41c8-9845-47009db9a2de tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:25.904504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-31c192e8-6ae6-4913-88a9-c72ebfef5aa8 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:25.906016 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-31c192e8-6ae6-4913-88a9-c72ebfef5aa8 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:25.918478 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-31c192e8-6ae6-4913-88a9-c72ebfef5aa8 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:25.920561 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-31c192e8-6ae6-4913-88a9-c72ebfef5aa8 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:25.921894 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-31c192e8-6ae6-4913-88a9-c72ebfef5aa8 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:25.923176 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-31c192e8-6ae6-4913-88a9-c72ebfef5aa8 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:25.924415 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-31c192e8-6ae6-4913-88a9-c72ebfef5aa8 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:25.924585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-cf4aad92-618a-41c8-9845-47009db9a2de tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:25.925564 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-31c192e8-6ae6-4913-88a9-c72ebfef5aa8 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:25.939224 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-cf4aad92-618a-41c8-9845-47009db9a2de tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1322 microversion: 2.1 time: 0.211535 Aug 31 12:30:25.940697 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 48/82] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:25 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:26.191736 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-f945441e-8a68-4e55-ba7a-51cff6da4b7c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:26.192855 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-f945441e-8a68-4e55-ba7a-51cff6da4b7c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:26.201870 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f945441e-8a68-4e55-ba7a-51cff6da4b7c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:26.202518 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f945441e-8a68-4e55-ba7a-51cff6da4b7c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:26.203438 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f945441e-8a68-4e55-ba7a-51cff6da4b7c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:26.204171 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f945441e-8a68-4e55-ba7a-51cff6da4b7c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:26.205200 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f945441e-8a68-4e55-ba7a-51cff6da4b7c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:26.205628 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f945441e-8a68-4e55-ba7a-51cff6da4b7c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:26.298490 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-31c192e8-6ae6-4913-88a9-c72ebfef5aa8 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:26.329655 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-31c192e8-6ae6-4913-88a9-c72ebfef5aa8 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1314 microversion: 2.1 time: 0.429532 Aug 31 12:30:26.334013 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 35/83] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:25 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:26.344535 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-4e821ba1-d1a3-40cf-9208-fafd370dcfa6 req-edbe1c2a-46ad-420f-925d-87b921d35c0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34ecec01-dd25-474d-addd-1d9b8de152b8", "tag": "da6f3218-a171-4509-bd68-c737a3ff6eaf"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:30:26.363505 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-4e821ba1-d1a3-40cf-9208-fafd370dcfa6 req-edbe1c2a-46ad-420f-925d-87b921d35c0c service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:26.364699 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-4e821ba1-d1a3-40cf-9208-fafd370dcfa6 req-edbe1c2a-46ad-420f-925d-87b921d35c0c service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:26.366600 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-4e821ba1-d1a3-40cf-9208-fafd370dcfa6 req-edbe1c2a-46ad-420f-925d-87b921d35c0c service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:26.393663 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-4e821ba1-d1a3-40cf-9208-fafd370dcfa6 req-edbe1c2a-46ad-420f-925d-87b921d35c0c service nova] Creating event network-changed:da6f3218-a171-4509-bd68-c737a3ff6eaf for instance 34ecec01-dd25-474d-addd-1d9b8de152b8 on hv-cinder-85528 Aug 31 12:30:26.414911 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-4e821ba1-d1a3-40cf-9208-fafd370dcfa6 req-edbe1c2a-46ad-420f-925d-87b921d35c0c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078676 Aug 31 12:30:26.418885 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 36/84] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:26.463364 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-f945441e-8a68-4e55-ba7a-51cff6da4b7c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:26.482742 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-f945441e-8a68-4e55-ba7a-51cff6da4b7c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1362 microversion: 2.1 time: 0.294625 Aug 31 12:30:26.484400 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 49/85] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:26 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1362 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:30:26.512809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-1ad794f5-1c0f-4278-81de-5366af55ae39 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:26.514758 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-1ad794f5-1c0f-4278-81de-5366af55ae39 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:26.529014 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1ad794f5-1c0f-4278-81de-5366af55ae39 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:26.530237 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1ad794f5-1c0f-4278-81de-5366af55ae39 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:26.531335 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1ad794f5-1c0f-4278-81de-5366af55ae39 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:26.532979 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1ad794f5-1c0f-4278-81de-5366af55ae39 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:26.534601 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1ad794f5-1c0f-4278-81de-5366af55ae39 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:26.535864 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1ad794f5-1c0f-4278-81de-5366af55ae39 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:26.882231 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-1ad794f5-1c0f-4278-81de-5366af55ae39 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:26.900646 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-1ad794f5-1c0f-4278-81de-5366af55ae39 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:26.903890 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-1ad794f5-1c0f-4278-81de-5366af55ae39 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:26.905747 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-1ad794f5-1c0f-4278-81de-5366af55ae39 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1408 microversion: 2.20 time: 0.402106 Aug 31 12:30:26.906698 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 37/86] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:30:26 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1408 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:30:26.968172 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-762499c3-605f-4e2b-91cd-fc109e4d6c25 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:26.970600 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-762499c3-605f-4e2b-91cd-fc109e4d6c25 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:26.981828 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-762499c3-605f-4e2b-91cd-fc109e4d6c25 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:26.983138 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-762499c3-605f-4e2b-91cd-fc109e4d6c25 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:26.984394 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-762499c3-605f-4e2b-91cd-fc109e4d6c25 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:26.986143 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-762499c3-605f-4e2b-91cd-fc109e4d6c25 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:26.987245 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-762499c3-605f-4e2b-91cd-fc109e4d6c25 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:26.988489 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-762499c3-605f-4e2b-91cd-fc109e4d6c25 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:27.376600 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-e28b9560-8b23-4d53-b893-f74abbb3e261 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:27.380543 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-e28b9560-8b23-4d53-b893-f74abbb3e261 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:27.401331 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e28b9560-8b23-4d53-b893-f74abbb3e261 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:27.406089 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e28b9560-8b23-4d53-b893-f74abbb3e261 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:27.412693 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e28b9560-8b23-4d53-b893-f74abbb3e261 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:27.414108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e28b9560-8b23-4d53-b893-f74abbb3e261 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:27.415301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e28b9560-8b23-4d53-b893-f74abbb3e261 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:27.416191 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e28b9560-8b23-4d53-b893-f74abbb3e261 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:27.967462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-762499c3-605f-4e2b-91cd-fc109e4d6c25 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:28.000570 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-762499c3-605f-4e2b-91cd-fc109e4d6c25 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1322 microversion: 2.1 time: 1.041833 Aug 31 12:30:28.003067 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 50/87] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:26 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1322 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:28.020604 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-68115d0f-62de-4afc-ab29-cfb8545ca210 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:28.021516 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-68115d0f-62de-4afc-ab29-cfb8545ca210 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:28.040180 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-68115d0f-62de-4afc-ab29-cfb8545ca210 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:28.053679 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-68115d0f-62de-4afc-ab29-cfb8545ca210 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:28.060037 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-68115d0f-62de-4afc-ab29-cfb8545ca210 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:28.063550 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-68115d0f-62de-4afc-ab29-cfb8545ca210 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:28.064301 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-68115d0f-62de-4afc-ab29-cfb8545ca210 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:28.065409 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-68115d0f-62de-4afc-ab29-cfb8545ca210 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:28.147985 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-e28b9560-8b23-4d53-b893-f74abbb3e261 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:28.195715 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-e28b9560-8b23-4d53-b893-f74abbb3e261 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1314 microversion: 2.1 time: 0.826317 Aug 31 12:30:28.211745 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 38/88] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:27 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1314 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:28.252975 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-141b2944-e621-40af-b126-d1fa3a93933e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:28.259525 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-141b2944-e621-40af-b126-d1fa3a93933e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:28.279364 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-141b2944-e621-40af-b126-d1fa3a93933e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:28.280488 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-141b2944-e621-40af-b126-d1fa3a93933e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:28.281911 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-141b2944-e621-40af-b126-d1fa3a93933e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:28.283691 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-141b2944-e621-40af-b126-d1fa3a93933e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:28.286893 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-141b2944-e621-40af-b126-d1fa3a93933e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:28.288471 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-141b2944-e621-40af-b126-d1fa3a93933e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:28.647751 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-68115d0f-62de-4afc-ab29-cfb8545ca210 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:28.680472 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=100 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:28.699438 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-68115d0f-62de-4afc-ab29-cfb8545ca210 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1362 microversion: 2.1 time: 0.694039 Aug 31 12:30:28.700290 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 51/89] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:28 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1362 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:28.736650 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-141b2944-e621-40af-b126-d1fa3a93933e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:28.750914 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-141b2944-e621-40af-b126-d1fa3a93933e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:28.758214 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-141b2944-e621-40af-b126-d1fa3a93933e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:28.759681 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-141b2944-e621-40af-b126-d1fa3a93933e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1408 microversion: 2.20 time: 0.527570 Aug 31 12:30:28.760666 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 39/90] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:30:28 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1408 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:30:29.060923 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-1d7db07f-193f-483f-b663-4a2904037d1a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:29.063384 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-1d7db07f-193f-483f-b663-4a2904037d1a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:29.081299 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1d7db07f-193f-483f-b663-4a2904037d1a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:29.084772 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1d7db07f-193f-483f-b663-4a2904037d1a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:29.088232 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1d7db07f-193f-483f-b663-4a2904037d1a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:29.089916 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1d7db07f-193f-483f-b663-4a2904037d1a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:29.091276 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1d7db07f-193f-483f-b663-4a2904037d1a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:29.093082 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1d7db07f-193f-483f-b663-4a2904037d1a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:29.248134 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-e0520776-5505-4a87-9b50-6b5d24a2be62 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:29.249748 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-e0520776-5505-4a87-9b50-6b5d24a2be62 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:29.257579 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e0520776-5505-4a87-9b50-6b5d24a2be62 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:29.258408 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e0520776-5505-4a87-9b50-6b5d24a2be62 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:29.259402 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e0520776-5505-4a87-9b50-6b5d24a2be62 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:29.260361 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e0520776-5505-4a87-9b50-6b5d24a2be62 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:29.261185 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e0520776-5505-4a87-9b50-6b5d24a2be62 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:29.262517 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e0520776-5505-4a87-9b50-6b5d24a2be62 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:29.381950 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-1d7db07f-193f-483f-b663-4a2904037d1a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:29.407223 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-1d7db07f-193f-483f-b663-4a2904037d1a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1322 microversion: 2.1 time: 0.355756 Aug 31 12:30:29.409519 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 52/91] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:29 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:29.502498 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-e0520776-5505-4a87-9b50-6b5d24a2be62 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:29.522274 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-e0520776-5505-4a87-9b50-6b5d24a2be62 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1314 microversion: 2.1 time: 0.280959 Aug 31 12:30:29.523990 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 40/92] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:29 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:30:29.730176 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-9359cc87-80e7-4af8-802c-38aef92e9842 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:29.732124 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-9359cc87-80e7-4af8-802c-38aef92e9842 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:29.752374 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9359cc87-80e7-4af8-802c-38aef92e9842 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:29.753486 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9359cc87-80e7-4af8-802c-38aef92e9842 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:29.754476 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9359cc87-80e7-4af8-802c-38aef92e9842 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:29.756281 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9359cc87-80e7-4af8-802c-38aef92e9842 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:29.757152 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9359cc87-80e7-4af8-802c-38aef92e9842 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:29.757897 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9359cc87-80e7-4af8-802c-38aef92e9842 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:29.793976 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-d6a858ea-c44f-4518-9821-9b969b2059f4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:29.795365 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-d6a858ea-c44f-4518-9821-9b969b2059f4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:29.818407 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d6a858ea-c44f-4518-9821-9b969b2059f4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:29.827409 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d6a858ea-c44f-4518-9821-9b969b2059f4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:29.828011 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d6a858ea-c44f-4518-9821-9b969b2059f4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:29.841186 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d6a858ea-c44f-4518-9821-9b969b2059f4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:29.841713 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d6a858ea-c44f-4518-9821-9b969b2059f4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:29.842176 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d6a858ea-c44f-4518-9821-9b969b2059f4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:30.100157 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-9359cc87-80e7-4af8-802c-38aef92e9842 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:30.112536 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-9359cc87-80e7-4af8-802c-38aef92e9842 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1362 microversion: 2.1 time: 0.391947 Aug 31 12:30:30.114240 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 53/93] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:29 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1362 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:30.189128 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-d6a858ea-c44f-4518-9821-9b969b2059f4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:30.215076 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-d6a858ea-c44f-4518-9821-9b969b2059f4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:30.218474 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-d6a858ea-c44f-4518-9821-9b969b2059f4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:30.220984 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-d6a858ea-c44f-4518-9821-9b969b2059f4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1408 microversion: 2.20 time: 0.439536 Aug 31 12:30:30.224961 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 41/94] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:30:29 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1408 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:30:30.434131 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-268b5587-f92c-429c-8bdf-f79d9e7b5724 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:30.436186 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-268b5587-f92c-429c-8bdf-f79d9e7b5724 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:30.445948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-268b5587-f92c-429c-8bdf-f79d9e7b5724 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:30.446913 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-268b5587-f92c-429c-8bdf-f79d9e7b5724 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:30.447550 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-268b5587-f92c-429c-8bdf-f79d9e7b5724 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:30.449555 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-268b5587-f92c-429c-8bdf-f79d9e7b5724 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:30.451616 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-268b5587-f92c-429c-8bdf-f79d9e7b5724 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:30.452605 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-268b5587-f92c-429c-8bdf-f79d9e7b5724 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:30.547645 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-47ae2148-4d5d-490d-9e55-400ff96e0a1c tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:30.549392 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-47ae2148-4d5d-490d-9e55-400ff96e0a1c tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:30.557407 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-47ae2148-4d5d-490d-9e55-400ff96e0a1c tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:30.559123 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-47ae2148-4d5d-490d-9e55-400ff96e0a1c tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:30.559842 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-47ae2148-4d5d-490d-9e55-400ff96e0a1c tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:30.561483 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-47ae2148-4d5d-490d-9e55-400ff96e0a1c tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:30.562764 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-47ae2148-4d5d-490d-9e55-400ff96e0a1c tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:30.563460 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-47ae2148-4d5d-490d-9e55-400ff96e0a1c tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:30.784314 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-268b5587-f92c-429c-8bdf-f79d9e7b5724 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:30.813125 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-268b5587-f92c-429c-8bdf-f79d9e7b5724 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1322 microversion: 2.1 time: 0.382982 Aug 31 12:30:30.815109 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 54/95] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:30 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1322 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:30.852633 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-47ae2148-4d5d-490d-9e55-400ff96e0a1c tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:30.868724 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-47ae2148-4d5d-490d-9e55-400ff96e0a1c tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1314 microversion: 2.1 time: 0.326142 Aug 31 12:30:30.870217 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 42/96] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:30 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:31.140536 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-eaa4146b-967f-434f-b39d-f267419c8bf7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:31.141337 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-eaa4146b-967f-434f-b39d-f267419c8bf7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:31.154731 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-eaa4146b-967f-434f-b39d-f267419c8bf7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:31.155610 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-eaa4146b-967f-434f-b39d-f267419c8bf7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:31.156272 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-eaa4146b-967f-434f-b39d-f267419c8bf7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:31.157030 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-eaa4146b-967f-434f-b39d-f267419c8bf7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:31.157638 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-eaa4146b-967f-434f-b39d-f267419c8bf7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:31.158065 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-eaa4146b-967f-434f-b39d-f267419c8bf7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:31.254130 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b71666b3-da77-4a99-82ea-1c8713d8bdb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:31.263501 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-b71666b3-da77-4a99-82ea-1c8713d8bdb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:31.269790 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell0:SELECT=2 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:31.283686 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b71666b3-da77-4a99-82ea-1c8713d8bdb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:31.291717 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b71666b3-da77-4a99-82ea-1c8713d8bdb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:31.292632 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b71666b3-da77-4a99-82ea-1c8713d8bdb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:31.299027 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b71666b3-da77-4a99-82ea-1c8713d8bdb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:31.300017 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b71666b3-da77-4a99-82ea-1c8713d8bdb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:31.300520 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b71666b3-da77-4a99-82ea-1c8713d8bdb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:31.483397 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-eaa4146b-967f-434f-b39d-f267419c8bf7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:31.533751 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-eaa4146b-967f-434f-b39d-f267419c8bf7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1362 microversion: 2.1 time: 0.377623 Aug 31 12:30:31.534685 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 55/97] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:31 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1362 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:30:31.672104 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b71666b3-da77-4a99-82ea-1c8713d8bdb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:31.683453 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b71666b3-da77-4a99-82ea-1c8713d8bdb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:31.687661 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b71666b3-da77-4a99-82ea-1c8713d8bdb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:31.689187 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b71666b3-da77-4a99-82ea-1c8713d8bdb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1408 microversion: 2.20 time: 0.445646 Aug 31 12:30:31.689963 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 43/98] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:30:31 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1408 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:30:31.844046 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-2b3743d4-e3e2-476e-9315-4c6e4dad8398 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:31.845116 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-2b3743d4-e3e2-476e-9315-4c6e4dad8398 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:31.863479 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2b3743d4-e3e2-476e-9315-4c6e4dad8398 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:31.863986 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2b3743d4-e3e2-476e-9315-4c6e4dad8398 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:31.864435 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2b3743d4-e3e2-476e-9315-4c6e4dad8398 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:31.865177 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2b3743d4-e3e2-476e-9315-4c6e4dad8398 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:31.869588 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2b3743d4-e3e2-476e-9315-4c6e4dad8398 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:31.870184 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2b3743d4-e3e2-476e-9315-4c6e4dad8398 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:31.900289 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-d2184f4a-8978-4d45-837c-184ab8b93f82 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:31.902829 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-d2184f4a-8978-4d45-837c-184ab8b93f82 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:31.929624 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d2184f4a-8978-4d45-837c-184ab8b93f82 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:31.931189 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d2184f4a-8978-4d45-837c-184ab8b93f82 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:31.934770 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d2184f4a-8978-4d45-837c-184ab8b93f82 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:31.939505 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d2184f4a-8978-4d45-837c-184ab8b93f82 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:31.940351 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d2184f4a-8978-4d45-837c-184ab8b93f82 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:31.941373 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d2184f4a-8978-4d45-837c-184ab8b93f82 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:32.262250 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-2b3743d4-e3e2-476e-9315-4c6e4dad8398 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:32.309970 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-2b3743d4-e3e2-476e-9315-4c6e4dad8398 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1322 microversion: 2.1 time: 0.470418 Aug 31 12:30:32.316277 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 56/99] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:31 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1322 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:32.454678 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-d2184f4a-8978-4d45-837c-184ab8b93f82 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:32.469534 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-d2184f4a-8978-4d45-837c-184ab8b93f82 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1314 microversion: 2.1 time: 0.581231 Aug 31 12:30:32.484618 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 44/100] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:31 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1314 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:30:32.578346 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-6699b2eb-17ba-444b-86c1-20248e160864 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:32.579629 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-6699b2eb-17ba-444b-86c1-20248e160864 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:32.594408 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6699b2eb-17ba-444b-86c1-20248e160864 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:32.597630 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6699b2eb-17ba-444b-86c1-20248e160864 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:32.600091 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6699b2eb-17ba-444b-86c1-20248e160864 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:32.602704 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6699b2eb-17ba-444b-86c1-20248e160864 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:32.604168 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6699b2eb-17ba-444b-86c1-20248e160864 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:32.605438 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6699b2eb-17ba-444b-86c1-20248e160864 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:32.718557 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-c0e2e47a-82ee-4059-96a6-c597bfd69069 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:32.719569 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-c0e2e47a-82ee-4059-96a6-c597bfd69069 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:32.755319 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c0e2e47a-82ee-4059-96a6-c597bfd69069 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:32.756134 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c0e2e47a-82ee-4059-96a6-c597bfd69069 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:32.758482 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c0e2e47a-82ee-4059-96a6-c597bfd69069 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:32.760606 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c0e2e47a-82ee-4059-96a6-c597bfd69069 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:32.763422 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c0e2e47a-82ee-4059-96a6-c597bfd69069 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:32.764623 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c0e2e47a-82ee-4059-96a6-c597bfd69069 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:32.831736 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=100 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:33.715805 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=2 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:34.054590 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-c0e2e47a-82ee-4059-96a6-c597bfd69069 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:34.085202 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-c0e2e47a-82ee-4059-96a6-c597bfd69069 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:34.087767 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-c0e2e47a-82ee-4059-96a6-c597bfd69069 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:34.091521 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-c0e2e47a-82ee-4059-96a6-c597bfd69069 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1408 microversion: 2.20 time: 1.379084 Aug 31 12:30:34.104325 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 45/101] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:30:32 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1408 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:30:34.104325 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-569304ee-f7b7-4a1a-ac79-3f8c42ea914e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:34.106827 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-569304ee-f7b7-4a1a-ac79-3f8c42ea914e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:34.129961 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-569304ee-f7b7-4a1a-ac79-3f8c42ea914e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:34.130362 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-569304ee-f7b7-4a1a-ac79-3f8c42ea914e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:34.131013 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-569304ee-f7b7-4a1a-ac79-3f8c42ea914e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:34.131992 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-569304ee-f7b7-4a1a-ac79-3f8c42ea914e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:34.132505 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-569304ee-f7b7-4a1a-ac79-3f8c42ea914e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:34.133021 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-569304ee-f7b7-4a1a-ac79-3f8c42ea914e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:34.139102 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-6699b2eb-17ba-444b-86c1-20248e160864 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:34.155741 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-6699b2eb-17ba-444b-86c1-20248e160864 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1362 microversion: 2.1 time: 1.583796 Aug 31 12:30:34.157812 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 57/102] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:32 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1362 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:34.181705 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-9abeeed6-ab07-4703-838b-f479dad076f2 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:34.182938 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-9abeeed6-ab07-4703-838b-f479dad076f2 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:34.201015 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9abeeed6-ab07-4703-838b-f479dad076f2 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:34.203238 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9abeeed6-ab07-4703-838b-f479dad076f2 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:34.205838 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9abeeed6-ab07-4703-838b-f479dad076f2 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:34.209220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9abeeed6-ab07-4703-838b-f479dad076f2 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:34.210743 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9abeeed6-ab07-4703-838b-f479dad076f2 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:34.211760 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9abeeed6-ab07-4703-838b-f479dad076f2 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:34.813447 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-9abeeed6-ab07-4703-838b-f479dad076f2 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:34.837009 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-9abeeed6-ab07-4703-838b-f479dad076f2 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1314 microversion: 2.1 time: 0.667562 Aug 31 12:30:34.842227 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 58/103] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:34 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1314 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:35.103375 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-569304ee-f7b7-4a1a-ac79-3f8c42ea914e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:35.121578 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-aef092a6-453e-4eab-8968-7b95a007166c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:35.122330 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-aef092a6-453e-4eab-8968-7b95a007166c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:35.122945 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-569304ee-f7b7-4a1a-ac79-3f8c42ea914e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1322 microversion: 2.1 time: 1.028439 Aug 31 12:30:35.124094 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 46/104] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:34 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1322 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:35.161578 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-aef092a6-453e-4eab-8968-7b95a007166c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:35.162114 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-aef092a6-453e-4eab-8968-7b95a007166c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:35.163984 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-aef092a6-453e-4eab-8968-7b95a007166c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:35.164755 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-aef092a6-453e-4eab-8968-7b95a007166c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:35.166156 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-aef092a6-453e-4eab-8968-7b95a007166c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:35.169105 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-aef092a6-453e-4eab-8968-7b95a007166c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:35.201171 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-bb2c2e78-5152-4259-a715-63620a176f29 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:35.202083 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-bb2c2e78-5152-4259-a715-63620a176f29 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:35.241772 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bb2c2e78-5152-4259-a715-63620a176f29 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:35.243641 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bb2c2e78-5152-4259-a715-63620a176f29 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:35.249678 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bb2c2e78-5152-4259-a715-63620a176f29 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:35.253644 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bb2c2e78-5152-4259-a715-63620a176f29 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:35.254542 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bb2c2e78-5152-4259-a715-63620a176f29 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:35.255250 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bb2c2e78-5152-4259-a715-63620a176f29 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:35.854522 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-aef092a6-453e-4eab-8968-7b95a007166c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:35.913327 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-aef092a6-453e-4eab-8968-7b95a007166c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:35.920481 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-aef092a6-453e-4eab-8968-7b95a007166c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:35.923960 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-aef092a6-453e-4eab-8968-7b95a007166c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1408 microversion: 2.20 time: 0.807496 Aug 31 12:30:35.931909 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 59/105] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:30:35 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1408 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:30:35.938584 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-424ffe29-e2ed-48ba-89d6-9f484d89d6c5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:35.943119 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-424ffe29-e2ed-48ba-89d6-9f484d89d6c5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:35.959241 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-424ffe29-e2ed-48ba-89d6-9f484d89d6c5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:35.960728 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-424ffe29-e2ed-48ba-89d6-9f484d89d6c5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:35.961529 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-424ffe29-e2ed-48ba-89d6-9f484d89d6c5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:35.963427 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-424ffe29-e2ed-48ba-89d6-9f484d89d6c5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:35.964213 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-424ffe29-e2ed-48ba-89d6-9f484d89d6c5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:35.965458 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-424ffe29-e2ed-48ba-89d6-9f484d89d6c5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:36.293542 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-bb2c2e78-5152-4259-a715-63620a176f29 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:36.306228 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-bb2c2e78-5152-4259-a715-63620a176f29 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1362 microversion: 2.1 time: 1.111746 Aug 31 12:30:36.306824 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 47/106] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:35 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1362 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:30:36.321278 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-1aa8c16b-6f5c-43d0-9240-a91538067ac5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:36.322919 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-1aa8c16b-6f5c-43d0-9240-a91538067ac5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:36.343991 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1aa8c16b-6f5c-43d0-9240-a91538067ac5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:36.347988 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1aa8c16b-6f5c-43d0-9240-a91538067ac5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:36.358629 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1aa8c16b-6f5c-43d0-9240-a91538067ac5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:36.362702 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1aa8c16b-6f5c-43d0-9240-a91538067ac5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:36.363823 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1aa8c16b-6f5c-43d0-9240-a91538067ac5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:36.366368 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1aa8c16b-6f5c-43d0-9240-a91538067ac5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:36.471616 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-424ffe29-e2ed-48ba-89d6-9f484d89d6c5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:36.485161 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-424ffe29-e2ed-48ba-89d6-9f484d89d6c5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1314 microversion: 2.1 time: 0.551824 Aug 31 12:30:36.486612 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 60/107] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:35 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:36.952040 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-d7e51fd4-c25d-41cf-843f-3817574e5e3d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:36.952686 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-d7e51fd4-c25d-41cf-843f-3817574e5e3d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:36.971512 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d7e51fd4-c25d-41cf-843f-3817574e5e3d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:36.972950 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d7e51fd4-c25d-41cf-843f-3817574e5e3d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:36.974017 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d7e51fd4-c25d-41cf-843f-3817574e5e3d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:36.975689 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d7e51fd4-c25d-41cf-843f-3817574e5e3d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:36.979544 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d7e51fd4-c25d-41cf-843f-3817574e5e3d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:36.981691 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d7e51fd4-c25d-41cf-843f-3817574e5e3d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:37.212834 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-1aa8c16b-6f5c-43d0-9240-a91538067ac5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:37.240499 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-1aa8c16b-6f5c-43d0-9240-a91538067ac5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1322 microversion: 2.1 time: 0.923766 Aug 31 12:30:37.247171 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 48/108] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:36 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1322 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:37.361947 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b28141eb-692e-4d73-a4b7-60be9d4ced55 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:37.363392 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-b28141eb-692e-4d73-a4b7-60be9d4ced55 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:37.383076 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b28141eb-692e-4d73-a4b7-60be9d4ced55 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:37.385376 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b28141eb-692e-4d73-a4b7-60be9d4ced55 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:37.390319 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b28141eb-692e-4d73-a4b7-60be9d4ced55 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:37.391272 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b28141eb-692e-4d73-a4b7-60be9d4ced55 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:37.393392 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b28141eb-692e-4d73-a4b7-60be9d4ced55 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:37.395207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b28141eb-692e-4d73-a4b7-60be9d4ced55 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:37.444408 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-d7e51fd4-c25d-41cf-843f-3817574e5e3d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:37.482565 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-d7e51fd4-c25d-41cf-843f-3817574e5e3d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:37.486183 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-d7e51fd4-c25d-41cf-843f-3817574e5e3d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:37.497568 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-d7e51fd4-c25d-41cf-843f-3817574e5e3d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1408 microversion: 2.20 time: 0.545412 Aug 31 12:30:37.498899 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 61/109] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:30:36 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1408 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:30:37.521021 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-f6974ca8-9da0-40f5-8dfa-8f1c92ec7656 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:37.525524 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-f6974ca8-9da0-40f5-8dfa-8f1c92ec7656 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:37.535040 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f6974ca8-9da0-40f5-8dfa-8f1c92ec7656 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:37.535814 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f6974ca8-9da0-40f5-8dfa-8f1c92ec7656 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:37.536479 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f6974ca8-9da0-40f5-8dfa-8f1c92ec7656 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:37.537418 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f6974ca8-9da0-40f5-8dfa-8f1c92ec7656 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:37.538093 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f6974ca8-9da0-40f5-8dfa-8f1c92ec7656 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:37.538774 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f6974ca8-9da0-40f5-8dfa-8f1c92ec7656 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:38.005905 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-f6974ca8-9da0-40f5-8dfa-8f1c92ec7656 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:38.024361 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-f6974ca8-9da0-40f5-8dfa-8f1c92ec7656 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1314 microversion: 2.1 time: 0.510756 Aug 31 12:30:38.024949 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 62/110] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:37 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:38.290467 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b28141eb-692e-4d73-a4b7-60be9d4ced55 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:38.302212 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b28141eb-692e-4d73-a4b7-60be9d4ced55 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1362 microversion: 2.1 time: 0.955082 Aug 31 12:30:38.302825 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 49/111] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:37 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1362 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:30:38.309465 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-fa3246ba-d59a-4b71-bdb8-4569f33f8ad1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:38.310235 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-fa3246ba-d59a-4b71-bdb8-4569f33f8ad1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:38.321340 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fa3246ba-d59a-4b71-bdb8-4569f33f8ad1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:38.322126 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fa3246ba-d59a-4b71-bdb8-4569f33f8ad1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:38.322774 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fa3246ba-d59a-4b71-bdb8-4569f33f8ad1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:38.324365 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fa3246ba-d59a-4b71-bdb8-4569f33f8ad1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:38.325022 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fa3246ba-d59a-4b71-bdb8-4569f33f8ad1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:38.325615 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fa3246ba-d59a-4b71-bdb8-4569f33f8ad1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:38.693958 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-fa3246ba-d59a-4b71-bdb8-4569f33f8ad1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:38.708285 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-fa3246ba-d59a-4b71-bdb8-4569f33f8ad1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1322 microversion: 2.1 time: 0.402176 Aug 31 12:30:38.712876 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 50/112] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:38 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1322 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:38.721068 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-f24715fa-040a-47bb-93cb-f116612d2506 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:38.722330 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-f24715fa-040a-47bb-93cb-f116612d2506 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:38.732481 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f24715fa-040a-47bb-93cb-f116612d2506 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:38.733234 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f24715fa-040a-47bb-93cb-f116612d2506 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:38.734093 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f24715fa-040a-47bb-93cb-f116612d2506 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:38.735156 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f24715fa-040a-47bb-93cb-f116612d2506 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:38.740594 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f24715fa-040a-47bb-93cb-f116612d2506 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:38.747026 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f24715fa-040a-47bb-93cb-f116612d2506 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:38.864761 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-6d452467-8a7e-4efc-8cc5-4f91c5778c1c req-b81c7818-0433-4620-8126-a908b89c6d36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59de5135-bc13-4ecc-a3b9-015b32aec285", "name": "network-vif-plugged", "status": "completed", "tag": "989a01eb-9f16-4e0f-b023-10a0ee6b8e11"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:30:38.890554 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-6d452467-8a7e-4efc-8cc5-4f91c5778c1c req-b81c7818-0433-4620-8126-a908b89c6d36 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:38.891344 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-6d452467-8a7e-4efc-8cc5-4f91c5778c1c req-b81c7818-0433-4620-8126-a908b89c6d36 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:38.891892 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-6d452467-8a7e-4efc-8cc5-4f91c5778c1c req-b81c7818-0433-4620-8126-a908b89c6d36 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:38.919025 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-6d452467-8a7e-4efc-8cc5-4f91c5778c1c req-b81c7818-0433-4620-8126-a908b89c6d36 service nova] Creating event network-vif-plugged:989a01eb-9f16-4e0f-b023-10a0ee6b8e11 for instance 59de5135-bc13-4ecc-a3b9-015b32aec285 on hv-cinder-85528 Aug 31 12:30:38.934973 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-6d452467-8a7e-4efc-8cc5-4f91c5778c1c req-b81c7818-0433-4620-8126-a908b89c6d36 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.896590 Aug 31 12:30:38.936445 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 63/113] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:39.051247 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-6eaa4f12-ab0b-4b1e-a9a7-f133ba2c9834 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:39.052314 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-6eaa4f12-ab0b-4b1e-a9a7-f133ba2c9834 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:39.065891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6eaa4f12-ab0b-4b1e-a9a7-f133ba2c9834 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:39.067847 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6eaa4f12-ab0b-4b1e-a9a7-f133ba2c9834 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:39.069171 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6eaa4f12-ab0b-4b1e-a9a7-f133ba2c9834 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:39.072765 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6eaa4f12-ab0b-4b1e-a9a7-f133ba2c9834 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:39.073537 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6eaa4f12-ab0b-4b1e-a9a7-f133ba2c9834 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:39.076778 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6eaa4f12-ab0b-4b1e-a9a7-f133ba2c9834 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:39.178329 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f24715fa-040a-47bb-93cb-f116612d2506 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:39.189669 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f24715fa-040a-47bb-93cb-f116612d2506 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:39.191869 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f24715fa-040a-47bb-93cb-f116612d2506 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:39.193532 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-f24715fa-040a-47bb-93cb-f116612d2506 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1408 microversion: 2.20 time: 0.479197 Aug 31 12:30:39.194678 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 51/114] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:30:38 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1408 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:30:39.342068 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-e2d6c38c-f2be-4a8f-9c6e-0140d13b5b3c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:39.343133 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-e2d6c38c-f2be-4a8f-9c6e-0140d13b5b3c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:39.362463 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e2d6c38c-f2be-4a8f-9c6e-0140d13b5b3c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:39.368361 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e2d6c38c-f2be-4a8f-9c6e-0140d13b5b3c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:39.369999 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e2d6c38c-f2be-4a8f-9c6e-0140d13b5b3c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:39.375233 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e2d6c38c-f2be-4a8f-9c6e-0140d13b5b3c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:39.376204 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e2d6c38c-f2be-4a8f-9c6e-0140d13b5b3c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:39.378895 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e2d6c38c-f2be-4a8f-9c6e-0140d13b5b3c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:39.521426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-6eaa4f12-ab0b-4b1e-a9a7-f133ba2c9834 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:39.538031 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-6eaa4f12-ab0b-4b1e-a9a7-f133ba2c9834 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1314 microversion: 2.1 time: 0.491127 Aug 31 12:30:39.540082 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 64/115] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:39 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:39.745202 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-98083cbe-da48-4402-aacd-c186e4895a2a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:39.748826 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-98083cbe-da48-4402-aacd-c186e4895a2a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:39.767354 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-98083cbe-da48-4402-aacd-c186e4895a2a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:39.769201 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-98083cbe-da48-4402-aacd-c186e4895a2a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:39.769955 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-98083cbe-da48-4402-aacd-c186e4895a2a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:39.770983 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-98083cbe-da48-4402-aacd-c186e4895a2a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:39.774018 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-98083cbe-da48-4402-aacd-c186e4895a2a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:39.774789 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-98083cbe-da48-4402-aacd-c186e4895a2a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:39.863859 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-e2d6c38c-f2be-4a8f-9c6e-0140d13b5b3c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:39.882168 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-e2d6c38c-f2be-4a8f-9c6e-0140d13b5b3c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1362 microversion: 2.1 time: 0.544520 Aug 31 12:30:39.898730 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 52/116] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:39 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1362 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:30:40.224366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-6090a875-24d8-4b5b-aea3-92ff129699ea tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:40.225599 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-6090a875-24d8-4b5b-aea3-92ff129699ea tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:40.240567 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6090a875-24d8-4b5b-aea3-92ff129699ea tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:40.247963 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6090a875-24d8-4b5b-aea3-92ff129699ea tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:40.252728 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6090a875-24d8-4b5b-aea3-92ff129699ea tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:40.254015 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6090a875-24d8-4b5b-aea3-92ff129699ea tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:40.259166 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6090a875-24d8-4b5b-aea3-92ff129699ea tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:40.269917 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6090a875-24d8-4b5b-aea3-92ff129699ea tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:40.604683 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-98083cbe-da48-4402-aacd-c186e4895a2a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:40.628959 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-98083cbe-da48-4402-aacd-c186e4895a2a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1322 microversion: 2.1 time: 0.896043 Aug 31 12:30:40.631091 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 65/117] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:39 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1322 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:40.662031 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-d04aff4b-8d2f-4629-9639-a4ab2fffa3a5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:40.663160 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-d04aff4b-8d2f-4629-9639-a4ab2fffa3a5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:40.672987 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d04aff4b-8d2f-4629-9639-a4ab2fffa3a5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:40.673922 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d04aff4b-8d2f-4629-9639-a4ab2fffa3a5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:40.674581 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d04aff4b-8d2f-4629-9639-a4ab2fffa3a5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:40.676105 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d04aff4b-8d2f-4629-9639-a4ab2fffa3a5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:40.677498 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d04aff4b-8d2f-4629-9639-a4ab2fffa3a5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:40.678766 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d04aff4b-8d2f-4629-9639-a4ab2fffa3a5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:40.854657 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-6090a875-24d8-4b5b-aea3-92ff129699ea tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:40.868949 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-6090a875-24d8-4b5b-aea3-92ff129699ea tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:40.875116 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-6090a875-24d8-4b5b-aea3-92ff129699ea tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:40.881456 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-6090a875-24d8-4b5b-aea3-92ff129699ea tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1408 microversion: 2.20 time: 0.661897 Aug 31 12:30:40.899262 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 53/118] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:30:40 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1408 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:30:40.944565 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-3af20fe2-3b6d-4829-954b-13a9b440cef1 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:40.945185 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-3af20fe2-3b6d-4829-954b-13a9b440cef1 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:40.964942 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3af20fe2-3b6d-4829-954b-13a9b440cef1 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:40.969360 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3af20fe2-3b6d-4829-954b-13a9b440cef1 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:40.970215 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3af20fe2-3b6d-4829-954b-13a9b440cef1 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:40.971698 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3af20fe2-3b6d-4829-954b-13a9b440cef1 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:40.975233 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3af20fe2-3b6d-4829-954b-13a9b440cef1 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:40.978842 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3af20fe2-3b6d-4829-954b-13a9b440cef1 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:41.387670 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-3af20fe2-3b6d-4829-954b-13a9b440cef1 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:41.403016 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-3af20fe2-3b6d-4829-954b-13a9b440cef1 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1362 microversion: 2.1 time: 0.464706 Aug 31 12:30:41.408845 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 54/119] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:40 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1362 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:41.416784 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-4b1de6e4-b13f-4eb2-a9d3-fd8d06c103fb req-70e04e6b-d492-456f-bd0b-72f402a25c12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbae24ec-b404-415c-97a7-a78cd28ff068", "name": "network-vif-plugged", "status": "completed", "tag": "beb6c22d-2e33-4df9-bc8d-b813944abaf7"}, {"server_uuid": "72fc3ffa-e316-44ad-8bd1-9767a06cf3ba", "name": "network-vif-plugged", "status": "completed", "tag": "41eb7341-e106-4e13-a267-482be8b20f73"}, {"server_uuid": "3490a556-866f-470d-953a-dab05d45e9e6", "name": "network-vif-plugged", "status": "completed", "tag": "0a707636-801a-41c6-8d9a-d69739984b5b"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:30:41.468467 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-4b1de6e4-b13f-4eb2-a9d3-fd8d06c103fb req-70e04e6b-d492-456f-bd0b-72f402a25c12 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:41.469305 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-4b1de6e4-b13f-4eb2-a9d3-fd8d06c103fb req-70e04e6b-d492-456f-bd0b-72f402a25c12 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:41.470051 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-4b1de6e4-b13f-4eb2-a9d3-fd8d06c103fb req-70e04e6b-d492-456f-bd0b-72f402a25c12 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:41.578259 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-d04aff4b-8d2f-4629-9639-a4ab2fffa3a5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:41.585572 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-4b1de6e4-b13f-4eb2-a9d3-fd8d06c103fb req-70e04e6b-d492-456f-bd0b-72f402a25c12 service nova] Creating event network-vif-plugged:beb6c22d-2e33-4df9-bc8d-b813944abaf7 for instance bbae24ec-b404-415c-97a7-a78cd28ff068 on hv-cinder-85528 Aug 31 12:30:41.589995 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-4b1de6e4-b13f-4eb2-a9d3-fd8d06c103fb req-70e04e6b-d492-456f-bd0b-72f402a25c12 service nova] Creating event network-vif-plugged:41eb7341-e106-4e13-a267-482be8b20f73 for instance 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba on hv-cinder-85528 Aug 31 12:30:41.593032 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-4b1de6e4-b13f-4eb2-a9d3-fd8d06c103fb req-70e04e6b-d492-456f-bd0b-72f402a25c12 service nova] Creating event network-vif-plugged:0a707636-801a-41c6-8d9a-d69739984b5b for instance 3490a556-866f-470d-953a-dab05d45e9e6 on hv-cinder-85528 Aug 31 12:30:41.613002 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-d04aff4b-8d2f-4629-9639-a4ab2fffa3a5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1314 microversion: 2.1 time: 0.979913 Aug 31 12:30:41.618670 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 66/120] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:40 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1314 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:41.627683 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-4b1de6e4-b13f-4eb2-a9d3-fd8d06c103fb req-70e04e6b-d492-456f-bd0b-72f402a25c12 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.215260 Aug 31 12:30:41.631212 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 55/121] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:41.661241 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-224ed710-d337-43ea-9d19-334cc108fe1c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:41.681931 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-224ed710-d337-43ea-9d19-334cc108fe1c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:41.704489 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-224ed710-d337-43ea-9d19-334cc108fe1c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:41.712736 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-224ed710-d337-43ea-9d19-334cc108fe1c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:41.716483 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-224ed710-d337-43ea-9d19-334cc108fe1c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:41.717779 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-224ed710-d337-43ea-9d19-334cc108fe1c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:41.718545 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-224ed710-d337-43ea-9d19-334cc108fe1c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:41.719391 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-224ed710-d337-43ea-9d19-334cc108fe1c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:41.924782 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-4ad580e2-07bc-4d4e-b9be-f3a764012a98 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:41.928251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-4ad580e2-07bc-4d4e-b9be-f3a764012a98 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:41.950770 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4ad580e2-07bc-4d4e-b9be-f3a764012a98 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:41.952205 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4ad580e2-07bc-4d4e-b9be-f3a764012a98 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:41.953107 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4ad580e2-07bc-4d4e-b9be-f3a764012a98 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:41.960074 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4ad580e2-07bc-4d4e-b9be-f3a764012a98 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:41.962563 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4ad580e2-07bc-4d4e-b9be-f3a764012a98 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:41.965264 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4ad580e2-07bc-4d4e-b9be-f3a764012a98 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:42.172309 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-224ed710-d337-43ea-9d19-334cc108fe1c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:42.188228 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-224ed710-d337-43ea-9d19-334cc108fe1c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1322 microversion: 2.1 time: 0.532993 Aug 31 12:30:42.210147 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 67/122] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:41 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1322 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:42.334974 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-4ad580e2-07bc-4d4e-b9be-f3a764012a98 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:42.356732 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-4ad580e2-07bc-4d4e-b9be-f3a764012a98 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:42.361106 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-4ad580e2-07bc-4d4e-b9be-f3a764012a98 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:42.367622 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-4ad580e2-07bc-4d4e-b9be-f3a764012a98 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1408 microversion: 2.20 time: 0.451274 Aug 31 12:30:42.369831 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 56/123] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:30:41 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1408 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:30:42.453720 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-9fcf2741-7cd3-4606-86e5-020c418b988c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:42.454727 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-9fcf2741-7cd3-4606-86e5-020c418b988c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:42.459390 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_api:SELECT=69 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:42.464174 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9fcf2741-7cd3-4606-86e5-020c418b988c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:42.465581 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9fcf2741-7cd3-4606-86e5-020c418b988c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:42.466078 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9fcf2741-7cd3-4606-86e5-020c418b988c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:42.466886 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9fcf2741-7cd3-4606-86e5-020c418b988c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:42.467547 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9fcf2741-7cd3-4606-86e5-020c418b988c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:42.467981 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9fcf2741-7cd3-4606-86e5-020c418b988c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:42.645453 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-f1c13090-692a-40ff-9e0c-d7911b12338b tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:42.646266 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-f1c13090-692a-40ff-9e0c-d7911b12338b tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:42.657464 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f1c13090-692a-40ff-9e0c-d7911b12338b tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:42.661370 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f1c13090-692a-40ff-9e0c-d7911b12338b tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:42.663294 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f1c13090-692a-40ff-9e0c-d7911b12338b tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:42.682571 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f1c13090-692a-40ff-9e0c-d7911b12338b tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:42.684446 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f1c13090-692a-40ff-9e0c-d7911b12338b tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:42.689540 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f1c13090-692a-40ff-9e0c-d7911b12338b tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:43.045328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-9fcf2741-7cd3-4606-86e5-020c418b988c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:43.060290 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-9fcf2741-7cd3-4606-86e5-020c418b988c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1362 microversion: 2.1 time: 0.621084 Aug 31 12:30:43.060892 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 68/124] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:42 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1362 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:30:43.214764 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-0d1313d2-7450-4d83-be7e-08db3f200562 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:43.216733 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-0d1313d2-7450-4d83-be7e-08db3f200562 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:43.227047 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0d1313d2-7450-4d83-be7e-08db3f200562 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:43.232410 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0d1313d2-7450-4d83-be7e-08db3f200562 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:43.233238 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0d1313d2-7450-4d83-be7e-08db3f200562 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:43.234334 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0d1313d2-7450-4d83-be7e-08db3f200562 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:43.234952 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0d1313d2-7450-4d83-be7e-08db3f200562 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:43.235614 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0d1313d2-7450-4d83-be7e-08db3f200562 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:43.295777 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=100 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:43.480603 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f1c13090-692a-40ff-9e0c-d7911b12338b tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:43.499050 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-f1c13090-692a-40ff-9e0c-d7911b12338b tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1314 microversion: 2.1 time: 0.857071 Aug 31 12:30:43.518892 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 57/125] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:42 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1314 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:43.535002 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-2df63aeb-f0fc-4414-8d49-9e81c76395ae tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:43.535872 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-2df63aeb-f0fc-4414-8d49-9e81c76395ae tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:43.547685 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2df63aeb-f0fc-4414-8d49-9e81c76395ae tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:43.548453 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2df63aeb-f0fc-4414-8d49-9e81c76395ae tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:43.549109 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2df63aeb-f0fc-4414-8d49-9e81c76395ae tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:43.550188 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2df63aeb-f0fc-4414-8d49-9e81c76395ae tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:43.550912 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2df63aeb-f0fc-4414-8d49-9e81c76395ae tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:43.551531 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2df63aeb-f0fc-4414-8d49-9e81c76395ae tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:43.594135 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-0d1313d2-7450-4d83-be7e-08db3f200562 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:43.609745 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-0d1313d2-7450-4d83-be7e-08db3f200562 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1322 microversion: 2.1 time: 0.399161 Aug 31 12:30:43.621814 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 69/126] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:43 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1322 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:43.709935 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-970f018a-8dde-4fdd-a8f4-83f5387e32b4 req-cec50c96-ac44-4323-92b3-b7e15a32a6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34ecec01-dd25-474d-addd-1d9b8de152b8", "name": "network-vif-plugged", "status": "completed", "tag": "da6f3218-a171-4509-bd68-c737a3ff6eaf"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:30:43.724362 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-970f018a-8dde-4fdd-a8f4-83f5387e32b4 req-cec50c96-ac44-4323-92b3-b7e15a32a6eb service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:43.725302 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-970f018a-8dde-4fdd-a8f4-83f5387e32b4 req-cec50c96-ac44-4323-92b3-b7e15a32a6eb service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:43.725961 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-970f018a-8dde-4fdd-a8f4-83f5387e32b4 req-cec50c96-ac44-4323-92b3-b7e15a32a6eb service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:43.743530 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-970f018a-8dde-4fdd-a8f4-83f5387e32b4 req-cec50c96-ac44-4323-92b3-b7e15a32a6eb service nova] Creating event network-vif-plugged:da6f3218-a171-4509-bd68-c737a3ff6eaf for instance 34ecec01-dd25-474d-addd-1d9b8de152b8 on hv-cinder-85528 Aug 31 12:30:43.750888 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-970f018a-8dde-4fdd-a8f4-83f5387e32b4 req-cec50c96-ac44-4323-92b3-b7e15a32a6eb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045260 Aug 31 12:30:43.756228 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 70/127] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:30:43.796500 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-2df63aeb-f0fc-4414-8d49-9e81c76395ae tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:43.811023 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-2df63aeb-f0fc-4414-8d49-9e81c76395ae tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:43.813071 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-2df63aeb-f0fc-4414-8d49-9e81c76395ae tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:43.814246 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-2df63aeb-f0fc-4414-8d49-9e81c76395ae tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1408 microversion: 2.20 time: 0.295102 Aug 31 12:30:43.819435 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 58/128] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:30:43 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1408 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:30:44.099012 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-a694b2bd-ecf5-4e2e-9b61-4c2cca2826ec tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:44.100213 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-a694b2bd-ecf5-4e2e-9b61-4c2cca2826ec tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:44.113327 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a694b2bd-ecf5-4e2e-9b61-4c2cca2826ec tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:44.114180 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a694b2bd-ecf5-4e2e-9b61-4c2cca2826ec tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:44.115370 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a694b2bd-ecf5-4e2e-9b61-4c2cca2826ec tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:44.117522 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a694b2bd-ecf5-4e2e-9b61-4c2cca2826ec tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:44.118928 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a694b2bd-ecf5-4e2e-9b61-4c2cca2826ec tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:44.120582 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a694b2bd-ecf5-4e2e-9b61-4c2cca2826ec tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:44.329839 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-a694b2bd-ecf5-4e2e-9b61-4c2cca2826ec tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:44.347234 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-a694b2bd-ecf5-4e2e-9b61-4c2cca2826ec tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1548 microversion: 2.1 time: 0.254507 Aug 31 12:30:44.348337 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 71/129] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:44 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1548 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:30:44.370191 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-3f964d84-5153-4d27-821e-0f2b59b92a4d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:44.371169 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-3f964d84-5153-4d27-821e-0f2b59b92a4d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:44.377974 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3f964d84-5153-4d27-821e-0f2b59b92a4d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:44.378475 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3f964d84-5153-4d27-821e-0f2b59b92a4d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:44.378950 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3f964d84-5153-4d27-821e-0f2b59b92a4d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:44.379688 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3f964d84-5153-4d27-821e-0f2b59b92a4d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:44.380156 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3f964d84-5153-4d27-821e-0f2b59b92a4d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:44.380584 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3f964d84-5153-4d27-821e-0f2b59b92a4d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:44.536744 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-3a05d2ea-3e7b-4eef-9413-8fd540591367 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:44.537447 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-3a05d2ea-3e7b-4eef-9413-8fd540591367 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:44.547278 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3a05d2ea-3e7b-4eef-9413-8fd540591367 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:44.548189 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3a05d2ea-3e7b-4eef-9413-8fd540591367 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:44.548863 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3a05d2ea-3e7b-4eef-9413-8fd540591367 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:44.550074 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3a05d2ea-3e7b-4eef-9413-8fd540591367 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:44.550810 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3a05d2ea-3e7b-4eef-9413-8fd540591367 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:44.551484 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3a05d2ea-3e7b-4eef-9413-8fd540591367 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:44.576803 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-3f964d84-5153-4d27-821e-0f2b59b92a4d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.210519 Aug 31 12:30:44.578097 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 59/130] 10.222.0.79 () {58 vars in 1275 bytes} [Wed Aug 31 12:30:44 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285/os-interface => generated 284 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:30:44.648712 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-85790fa0-e806-459f-8d88-85abf12a1164 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:44.650817 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-85790fa0-e806-459f-8d88-85abf12a1164 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:44.684671 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-85790fa0-e806-459f-8d88-85abf12a1164 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:44.686408 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-85790fa0-e806-459f-8d88-85abf12a1164 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:44.687219 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-85790fa0-e806-459f-8d88-85abf12a1164 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:44.688634 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-85790fa0-e806-459f-8d88-85abf12a1164 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:44.689632 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-85790fa0-e806-459f-8d88-85abf12a1164 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:44.690807 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-85790fa0-e806-459f-8d88-85abf12a1164 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:45.015765 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-3a05d2ea-3e7b-4eef-9413-8fd540591367 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:45.055143 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-3a05d2ea-3e7b-4eef-9413-8fd540591367 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1314 microversion: 2.1 time: 0.516797 Aug 31 12:30:45.057434 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 72/131] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:44 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1314 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:45.069746 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-0c9cee2a-4799-4ba2-902a-f1dbd1a2b8e9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:45.100955 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-0c9cee2a-4799-4ba2-902a-f1dbd1a2b8e9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:45.115044 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0c9cee2a-4799-4ba2-902a-f1dbd1a2b8e9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:45.117467 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0c9cee2a-4799-4ba2-902a-f1dbd1a2b8e9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:45.119212 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0c9cee2a-4799-4ba2-902a-f1dbd1a2b8e9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:45.120980 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0c9cee2a-4799-4ba2-902a-f1dbd1a2b8e9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:45.122094 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0c9cee2a-4799-4ba2-902a-f1dbd1a2b8e9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:45.123271 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0c9cee2a-4799-4ba2-902a-f1dbd1a2b8e9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:45.138166 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-85790fa0-e806-459f-8d88-85abf12a1164 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:45.178405 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-85790fa0-e806-459f-8d88-85abf12a1164 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1322 microversion: 2.1 time: 0.546909 Aug 31 12:30:45.185147 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 60/132] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:44 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1322 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:45.515032 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-0c9cee2a-4799-4ba2-902a-f1dbd1a2b8e9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:45.534493 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-0c9cee2a-4799-4ba2-902a-f1dbd1a2b8e9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:45.541533 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-0c9cee2a-4799-4ba2-902a-f1dbd1a2b8e9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:45.546405 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-0c9cee2a-4799-4ba2-902a-f1dbd1a2b8e9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1408 microversion: 2.20 time: 0.485630 Aug 31 12:30:45.551523 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 73/133] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:30:45 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1408 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:30:46.079916 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-7a1acf85-e0ec-4085-a313-6e984cf9add3 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:46.080838 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-7a1acf85-e0ec-4085-a313-6e984cf9add3 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:46.098801 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7a1acf85-e0ec-4085-a313-6e984cf9add3 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:46.101210 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7a1acf85-e0ec-4085-a313-6e984cf9add3 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:46.102895 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7a1acf85-e0ec-4085-a313-6e984cf9add3 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:46.104514 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7a1acf85-e0ec-4085-a313-6e984cf9add3 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:46.106148 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7a1acf85-e0ec-4085-a313-6e984cf9add3 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:46.107175 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7a1acf85-e0ec-4085-a313-6e984cf9add3 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:46.223209 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-03c5dcfa-66c6-4ef2-9316-864712c76266 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:46.224973 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-03c5dcfa-66c6-4ef2-9316-864712c76266 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:46.237198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-03c5dcfa-66c6-4ef2-9316-864712c76266 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:46.241424 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-03c5dcfa-66c6-4ef2-9316-864712c76266 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:46.241956 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-03c5dcfa-66c6-4ef2-9316-864712c76266 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:46.244052 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-03c5dcfa-66c6-4ef2-9316-864712c76266 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:46.249755 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-03c5dcfa-66c6-4ef2-9316-864712c76266 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:46.250715 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-03c5dcfa-66c6-4ef2-9316-864712c76266 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:46.648952 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-03c5dcfa-66c6-4ef2-9316-864712c76266 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:46.663395 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-03c5dcfa-66c6-4ef2-9316-864712c76266 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1515 microversion: 2.1 time: 0.444120 Aug 31 12:30:46.666063 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 74/134] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:46 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1515 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:30:46.674247 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-8b0d9adc-9fa2-4569-8474-f3bf7fa8e5f8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:46.675165 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-8b0d9adc-9fa2-4569-8474-f3bf7fa8e5f8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:46.686638 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8b0d9adc-9fa2-4569-8474-f3bf7fa8e5f8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:46.687764 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8b0d9adc-9fa2-4569-8474-f3bf7fa8e5f8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:46.688428 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8b0d9adc-9fa2-4569-8474-f3bf7fa8e5f8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:46.689528 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8b0d9adc-9fa2-4569-8474-f3bf7fa8e5f8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:46.690269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8b0d9adc-9fa2-4569-8474-f3bf7fa8e5f8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:46.691125 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8b0d9adc-9fa2-4569-8474-f3bf7fa8e5f8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:47.009664 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8b0d9adc-9fa2-4569-8474-f3bf7fa8e5f8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:47.023785 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8b0d9adc-9fa2-4569-8474-f3bf7fa8e5f8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:47.027985 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8b0d9adc-9fa2-4569-8474-f3bf7fa8e5f8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:47.030167 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-8b0d9adc-9fa2-4569-8474-f3bf7fa8e5f8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1408 microversion: 2.20 time: 0.362465 Aug 31 12:30:47.031786 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 75/135] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:30:46 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1408 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:30:47.039807 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-c6214f07-b3fc-4f36-9659-a7b8f0b6a7c0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:30:47.043840 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-c6214f07-b3fc-4f36-9659-a7b8f0b6a7c0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:47.054180 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c6214f07-b3fc-4f36-9659-a7b8f0b6a7c0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:47.056162 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c6214f07-b3fc-4f36-9659-a7b8f0b6a7c0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:47.056861 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c6214f07-b3fc-4f36-9659-a7b8f0b6a7c0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:47.058451 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c6214f07-b3fc-4f36-9659-a7b8f0b6a7c0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:47.059395 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c6214f07-b3fc-4f36-9659-a7b8f0b6a7c0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:47.059996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c6214f07-b3fc-4f36-9659-a7b8f0b6a7c0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:47.074986 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-7a1acf85-e0ec-4085-a313-6e984cf9add3 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:47.098137 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-7a1acf85-e0ec-4085-a313-6e984cf9add3 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1500 microversion: 2.1 time: 1.023507 Aug 31 12:30:47.111419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 61/136] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:46 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1500 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:47.265873 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.objects.instance [None req-c6214f07-b3fc-4f36-9659-a7b8f0b6a7c0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lazy-loading 'flavor' on Instance uuid 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba {{(pid=120749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:30:47.711863 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-c6214f07-b3fc-4f36-9659-a7b8f0b6a7c0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "POST /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba/action" status: 200 len: 32 microversion: 2.1 time: 0.671858 Aug 31 12:30:47.720227 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 76/137] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Aug 31 12:30:47 2022] POST /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba/action => generated 32 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 12:30:47.733690 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-8da3ed96-f38c-4936-aa22-bbbf8a608a17 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:47.735880 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-8da3ed96-f38c-4936-aa22-bbbf8a608a17 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:47.754157 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8da3ed96-f38c-4936-aa22-bbbf8a608a17 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:47.755335 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8da3ed96-f38c-4936-aa22-bbbf8a608a17 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:47.757921 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8da3ed96-f38c-4936-aa22-bbbf8a608a17 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:47.760764 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8da3ed96-f38c-4936-aa22-bbbf8a608a17 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:47.763787 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8da3ed96-f38c-4936-aa22-bbbf8a608a17 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:47.766315 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8da3ed96-f38c-4936-aa22-bbbf8a608a17 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:48.084215 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-a5eb95f8-c8c1-4c45-98e6-5a58ee5cb538 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:48.088065 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-a5eb95f8-c8c1-4c45-98e6-5a58ee5cb538 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:48.129116 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a5eb95f8-c8c1-4c45-98e6-5a58ee5cb538 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:48.130402 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a5eb95f8-c8c1-4c45-98e6-5a58ee5cb538 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:48.131836 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a5eb95f8-c8c1-4c45-98e6-5a58ee5cb538 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:48.133748 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a5eb95f8-c8c1-4c45-98e6-5a58ee5cb538 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:48.138890 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a5eb95f8-c8c1-4c45-98e6-5a58ee5cb538 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:48.140444 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a5eb95f8-c8c1-4c45-98e6-5a58ee5cb538 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:48.364317 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-8da3ed96-f38c-4936-aa22-bbbf8a608a17 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:48.378562 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-8da3ed96-f38c-4936-aa22-bbbf8a608a17 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.654228 Aug 31 12:30:48.393957 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 62/138] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:47 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:48.532229 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-a5eb95f8-c8c1-4c45-98e6-5a58ee5cb538 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:48.541924 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-dc75174f-b83e-4d1b-a687-8f5e19130d01 req-17f78607-86a6-44f3-a4ba-32418a2f8767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59de5135-bc13-4ecc-a3b9-015b32aec285", "tag": "989a01eb-9f16-4e0f-b023-10a0ee6b8e11"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:30:48.556613 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-dc75174f-b83e-4d1b-a687-8f5e19130d01 req-17f78607-86a6-44f3-a4ba-32418a2f8767 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:48.559219 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-dc75174f-b83e-4d1b-a687-8f5e19130d01 req-17f78607-86a6-44f3-a4ba-32418a2f8767 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:48.560285 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-dc75174f-b83e-4d1b-a687-8f5e19130d01 req-17f78607-86a6-44f3-a4ba-32418a2f8767 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:48.563468 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-a5eb95f8-c8c1-4c45-98e6-5a58ee5cb538 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:48.567792 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=100 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:48.573474 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-a5eb95f8-c8c1-4c45-98e6-5a58ee5cb538 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:48.592217 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-a5eb95f8-c8c1-4c45-98e6-5a58ee5cb538 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1408 microversion: 2.20 time: 0.524971 Aug 31 12:30:48.595152 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 77/139] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:30:48 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1408 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:30:48.655445 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-dc75174f-b83e-4d1b-a687-8f5e19130d01 req-17f78607-86a6-44f3-a4ba-32418a2f8767 service nova] Creating event network-changed:989a01eb-9f16-4e0f-b023-10a0ee6b8e11 for instance 59de5135-bc13-4ecc-a3b9-015b32aec285 on hv-cinder-85528 Aug 31 12:30:48.669956 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-dc75174f-b83e-4d1b-a687-8f5e19130d01 req-17f78607-86a6-44f3-a4ba-32418a2f8767 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132170 Aug 31 12:30:48.680826 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 63/140] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:49.222754 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-616216b3-1345-43a5-8755-1cc7096b4767 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b65cf56-4b11-4ef7-ad76-da132e21857b"}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:30:49.225743 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-616216b3-1345-43a5-8755-1cc7096b4767 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:49.238477 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-616216b3-1345-43a5-8755-1cc7096b4767 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:49.239465 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-616216b3-1345-43a5-8755-1cc7096b4767 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:49.240484 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-616216b3-1345-43a5-8755-1cc7096b4767 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:49.242426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-616216b3-1345-43a5-8755-1cc7096b4767 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:49.243216 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-616216b3-1345-43a5-8755-1cc7096b4767 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:49.243815 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-616216b3-1345-43a5-8755-1cc7096b4767 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:49.411029 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-f294a3fa-56a3-46dd-b0a2-4f72147405b8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:49.422402 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-f294a3fa-56a3-46dd-b0a2-4f72147405b8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:49.468713 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f294a3fa-56a3-46dd-b0a2-4f72147405b8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:49.478370 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f294a3fa-56a3-46dd-b0a2-4f72147405b8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:49.480898 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f294a3fa-56a3-46dd-b0a2-4f72147405b8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:49.482733 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f294a3fa-56a3-46dd-b0a2-4f72147405b8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:49.483897 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f294a3fa-56a3-46dd-b0a2-4f72147405b8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:49.486145 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f294a3fa-56a3-46dd-b0a2-4f72147405b8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:49.841203 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-616216b3-1345-43a5-8755-1cc7096b4767 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "POST /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.621885 Aug 31 12:30:49.861065 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 78/141] 10.222.0.79 () {60 vars in 1323 bytes} [Wed Aug 31 12:30:49 2022] POST /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6/os-volume_attachments => generated 194 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:49.888746 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-e2326162-143a-4b6a-bc05-9496c392a5e1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:49.892993 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-e2326162-143a-4b6a-bc05-9496c392a5e1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:49.910202 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2326162-143a-4b6a-bc05-9496c392a5e1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:49.910748 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2326162-143a-4b6a-bc05-9496c392a5e1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:49.912632 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2326162-143a-4b6a-bc05-9496c392a5e1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:49.915442 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2326162-143a-4b6a-bc05-9496c392a5e1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:49.916018 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2326162-143a-4b6a-bc05-9496c392a5e1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:49.916570 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2326162-143a-4b6a-bc05-9496c392a5e1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:50.595943 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f294a3fa-56a3-46dd-b0a2-4f72147405b8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:50.612373 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-f294a3fa-56a3-46dd-b0a2-4f72147405b8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 1.211876 Aug 31 12:30:50.627553 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 64/142] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:49 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:50.670709 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-e2326162-143a-4b6a-bc05-9496c392a5e1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:50.704969 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-e2326162-143a-4b6a-bc05-9496c392a5e1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:50.712268 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-e2326162-143a-4b6a-bc05-9496c392a5e1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:50.716046 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-e2326162-143a-4b6a-bc05-9496c392a5e1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1600 microversion: 2.20 time: 0.851668 Aug 31 12:30:50.738327 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 79/143] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:30:49 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1600 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:30:50.769297 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-8094e588-473b-484f-adf9-0e8510199fca tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:50.770639 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-8094e588-473b-484f-adf9-0e8510199fca tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:50.809633 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8094e588-473b-484f-adf9-0e8510199fca tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:50.811112 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8094e588-473b-484f-adf9-0e8510199fca tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:50.812153 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8094e588-473b-484f-adf9-0e8510199fca tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:50.813673 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8094e588-473b-484f-adf9-0e8510199fca tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:50.814728 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8094e588-473b-484f-adf9-0e8510199fca tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:50.815931 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8094e588-473b-484f-adf9-0e8510199fca tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:51.015481 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-8094e588-473b-484f-adf9-0e8510199fca tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.257284 Aug 31 12:30:51.017157 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 65/144] 10.222.0.79 () {60 vars in 1316 bytes} [Wed Aug 31 12:30:50 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8/os-interface => generated 284 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:30:51.638550 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-af997955-ce09-4f20-b39d-802225d53a69 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:51.639203 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-af997955-ce09-4f20-b39d-802225d53a69 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:51.663933 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-af997955-ce09-4f20-b39d-802225d53a69 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:51.668415 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-af997955-ce09-4f20-b39d-802225d53a69 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:51.669159 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-af997955-ce09-4f20-b39d-802225d53a69 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:51.669922 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-af997955-ce09-4f20-b39d-802225d53a69 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:51.670395 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-af997955-ce09-4f20-b39d-802225d53a69 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:51.670915 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-af997955-ce09-4f20-b39d-802225d53a69 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:52.076234 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-af997955-ce09-4f20-b39d-802225d53a69 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:52.100091 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-af997955-ce09-4f20-b39d-802225d53a69 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.466408 Aug 31 12:30:52.107981 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 80/145] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:51 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:30:53.136905 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-f2755e74-f18e-42ff-87a3-036cbd5534be tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:53.139164 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-f2755e74-f18e-42ff-87a3-036cbd5534be tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:53.154103 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_api:SELECT=74 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:53.157162 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f2755e74-f18e-42ff-87a3-036cbd5534be tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:53.157636 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f2755e74-f18e-42ff-87a3-036cbd5534be tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:53.158415 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f2755e74-f18e-42ff-87a3-036cbd5534be tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:53.159577 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f2755e74-f18e-42ff-87a3-036cbd5534be tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:53.161018 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f2755e74-f18e-42ff-87a3-036cbd5534be tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:53.162156 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f2755e74-f18e-42ff-87a3-036cbd5534be tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:53.415082 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f2755e74-f18e-42ff-87a3-036cbd5534be tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:53.427085 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-f2755e74-f18e-42ff-87a3-036cbd5534be tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.294356 Aug 31 12:30:53.459537 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 66/146] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:53 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:53.482824 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-ff1ac648-227c-4a3d-90d1-f95b1418bb4d req-9d4e21cd-3b0d-415c-8417-bde382b66230 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34ecec01-dd25-474d-addd-1d9b8de152b8", "tag": "da6f3218-a171-4509-bd68-c737a3ff6eaf"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:30:53.526484 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-ff1ac648-227c-4a3d-90d1-f95b1418bb4d req-9d4e21cd-3b0d-415c-8417-bde382b66230 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:53.527866 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-ff1ac648-227c-4a3d-90d1-f95b1418bb4d req-9d4e21cd-3b0d-415c-8417-bde382b66230 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:53.532288 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-ff1ac648-227c-4a3d-90d1-f95b1418bb4d req-9d4e21cd-3b0d-415c-8417-bde382b66230 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:53.559856 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-ff1ac648-227c-4a3d-90d1-f95b1418bb4d req-9d4e21cd-3b0d-415c-8417-bde382b66230 service nova] Creating event network-changed:da6f3218-a171-4509-bd68-c737a3ff6eaf for instance 34ecec01-dd25-474d-addd-1d9b8de152b8 on hv-cinder-85528 Aug 31 12:30:53.565735 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-ff1ac648-227c-4a3d-90d1-f95b1418bb4d req-9d4e21cd-3b0d-415c-8417-bde382b66230 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090594 Aug 31 12:30:53.567904 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 81/147] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:30:54.461466 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-4b558535-2a51-499d-b8c5-df9bab0ab14f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:54.463222 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-4b558535-2a51-499d-b8c5-df9bab0ab14f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:54.479045 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4b558535-2a51-499d-b8c5-df9bab0ab14f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:54.484174 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4b558535-2a51-499d-b8c5-df9bab0ab14f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:54.484866 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4b558535-2a51-499d-b8c5-df9bab0ab14f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:54.485641 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4b558535-2a51-499d-b8c5-df9bab0ab14f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:54.486152 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4b558535-2a51-499d-b8c5-df9bab0ab14f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:54.491675 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4b558535-2a51-499d-b8c5-df9bab0ab14f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:55.019260 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-4b558535-2a51-499d-b8c5-df9bab0ab14f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:55.043695 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-4b558535-2a51-499d-b8c5-df9bab0ab14f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.589893 Aug 31 12:30:55.047247 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 67/148] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:54 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:56.072429 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-44e30b54-8fa3-4182-a2f4-88dc0119473b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:56.082503 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-44e30b54-8fa3-4182-a2f4-88dc0119473b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:56.089889 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-44e30b54-8fa3-4182-a2f4-88dc0119473b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:56.090798 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-44e30b54-8fa3-4182-a2f4-88dc0119473b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:56.091502 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-44e30b54-8fa3-4182-a2f4-88dc0119473b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:56.092495 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-44e30b54-8fa3-4182-a2f4-88dc0119473b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:56.093461 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-44e30b54-8fa3-4182-a2f4-88dc0119473b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:56.093967 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-44e30b54-8fa3-4182-a2f4-88dc0119473b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:56.425922 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-44e30b54-8fa3-4182-a2f4-88dc0119473b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:56.437973 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-44e30b54-8fa3-4182-a2f4-88dc0119473b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.371062 Aug 31 12:30:56.438539 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 82/149] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:56 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:30:57.478313 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-2f651a57-3578-4dea-9cd0-bc739d31e9ed tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:57.479382 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-2f651a57-3578-4dea-9cd0-bc739d31e9ed tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:57.496496 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2f651a57-3578-4dea-9cd0-bc739d31e9ed tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:57.498825 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2f651a57-3578-4dea-9cd0-bc739d31e9ed tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:57.500006 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2f651a57-3578-4dea-9cd0-bc739d31e9ed tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:57.501833 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2f651a57-3578-4dea-9cd0-bc739d31e9ed tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:57.503080 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2f651a57-3578-4dea-9cd0-bc739d31e9ed tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:57.504086 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2f651a57-3578-4dea-9cd0-bc739d31e9ed tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:57.858839 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-2f651a57-3578-4dea-9cd0-bc739d31e9ed tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:57.875099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-2f651a57-3578-4dea-9cd0-bc739d31e9ed tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.404736 Aug 31 12:30:57.875759 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 68/150] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:57 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:58.920421 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-b14e3716-58c7-46c4-bdb0-5c6c370b2c34 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:58.921447 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-b14e3716-58c7-46c4-bdb0-5c6c370b2c34 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:58.929307 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b14e3716-58c7-46c4-bdb0-5c6c370b2c34 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:58.929934 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b14e3716-58c7-46c4-bdb0-5c6c370b2c34 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:58.930477 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b14e3716-58c7-46c4-bdb0-5c6c370b2c34 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:58.931378 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b14e3716-58c7-46c4-bdb0-5c6c370b2c34 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:58.931914 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b14e3716-58c7-46c4-bdb0-5c6c370b2c34 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:58.932427 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b14e3716-58c7-46c4-bdb0-5c6c370b2c34 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:59.112884 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-b14e3716-58c7-46c4-bdb0-5c6c370b2c34 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:59.119445 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:59.137325 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-b14e3716-58c7-46c4-bdb0-5c6c370b2c34 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.223210 Aug 31 12:30:59.139286 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 83/151] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:58 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:59.271165 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-ef0f91e0-78b5-4977-a827-1a74d07ec3c9 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:59.273361 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-ef0f91e0-78b5-4977-a827-1a74d07ec3c9 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:59.290524 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ef0f91e0-78b5-4977-a827-1a74d07ec3c9 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:59.291977 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ef0f91e0-78b5-4977-a827-1a74d07ec3c9 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:59.295715 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ef0f91e0-78b5-4977-a827-1a74d07ec3c9 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:59.297234 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ef0f91e0-78b5-4977-a827-1a74d07ec3c9 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:59.298931 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ef0f91e0-78b5-4977-a827-1a74d07ec3c9 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:59.300374 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ef0f91e0-78b5-4977-a827-1a74d07ec3c9 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:59.366770 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-ef0f91e0-78b5-4977-a827-1a74d07ec3c9 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Going to try to terminate instance {{(pid=120750) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:30:59.526297 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-ef0f91e0-78b5-4977-a827-1a74d07ec3c9 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 204 len: 0 microversion: 2.1 time: 0.261432 Aug 31 12:30:59.528100 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 69/152] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 31 12:30:59 2022] DELETE /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:30:59.540256 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-cf730680-f93b-494a-80e9-0059053ced22 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:59.541094 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-cf730680-f93b-494a-80e9-0059053ced22 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:59.549699 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cf730680-f93b-494a-80e9-0059053ced22 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:59.550291 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cf730680-f93b-494a-80e9-0059053ced22 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:59.550723 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cf730680-f93b-494a-80e9-0059053ced22 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:59.551459 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cf730680-f93b-494a-80e9-0059053ced22 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:59.551904 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cf730680-f93b-494a-80e9-0059053ced22 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:59.552321 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cf730680-f93b-494a-80e9-0059053ced22 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:59.722461 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-cf730680-f93b-494a-80e9-0059053ced22 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:59.736291 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-cf730680-f93b-494a-80e9-0059053ced22 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1552 microversion: 2.1 time: 0.201489 Aug 31 12:30:59.737376 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 84/153] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:59 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1552 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:00.161074 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-07f5dcde-759e-4b32-87dd-74ead27a3c8f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:00.161796 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-07f5dcde-759e-4b32-87dd-74ead27a3c8f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:00.169092 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-07f5dcde-759e-4b32-87dd-74ead27a3c8f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:00.169589 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-07f5dcde-759e-4b32-87dd-74ead27a3c8f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:00.170027 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-07f5dcde-759e-4b32-87dd-74ead27a3c8f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:00.170742 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-07f5dcde-759e-4b32-87dd-74ead27a3c8f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:00.171251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-07f5dcde-759e-4b32-87dd-74ead27a3c8f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:00.171669 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-07f5dcde-759e-4b32-87dd-74ead27a3c8f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:00.343963 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-07f5dcde-759e-4b32-87dd-74ead27a3c8f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:00.354050 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-07f5dcde-759e-4b32-87dd-74ead27a3c8f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.197191 Aug 31 12:31:00.354806 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 70/154] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:00 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:00.765983 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-30fdfde4-3c36-4f6b-88ba-8df09d24e85d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:00.767025 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-30fdfde4-3c36-4f6b-88ba-8df09d24e85d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:00.779595 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-30fdfde4-3c36-4f6b-88ba-8df09d24e85d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:00.780387 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-30fdfde4-3c36-4f6b-88ba-8df09d24e85d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:00.781174 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-30fdfde4-3c36-4f6b-88ba-8df09d24e85d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:00.782441 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-30fdfde4-3c36-4f6b-88ba-8df09d24e85d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:00.783281 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-30fdfde4-3c36-4f6b-88ba-8df09d24e85d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:00.784049 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-30fdfde4-3c36-4f6b-88ba-8df09d24e85d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:01.313450 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-30fdfde4-3c36-4f6b-88ba-8df09d24e85d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:01.342619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-30fdfde4-3c36-4f6b-88ba-8df09d24e85d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1552 microversion: 2.1 time: 0.579063 Aug 31 12:31:01.378067 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 85/155] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:00 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1552 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:01.389717 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-61c94d25-897c-44f5-be19-4f294d493ab6 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:01.391547 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-61c94d25-897c-44f5-be19-4f294d493ab6 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:01.398518 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-61c94d25-897c-44f5-be19-4f294d493ab6 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:01.399415 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-61c94d25-897c-44f5-be19-4f294d493ab6 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:01.400087 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-61c94d25-897c-44f5-be19-4f294d493ab6 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:01.402429 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-61c94d25-897c-44f5-be19-4f294d493ab6 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:01.403268 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-61c94d25-897c-44f5-be19-4f294d493ab6 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:01.404329 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-61c94d25-897c-44f5-be19-4f294d493ab6 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:01.640322 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-61c94d25-897c-44f5-be19-4f294d493ab6 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:01.672134 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-61c94d25-897c-44f5-be19-4f294d493ab6 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.298267 Aug 31 12:31:01.674258 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 71/156] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:01 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:31:02.369190 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-957a597b-00ee-4dd1-8a90-0315f421d685 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:02.370307 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-957a597b-00ee-4dd1-8a90-0315f421d685 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:02.383272 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-957a597b-00ee-4dd1-8a90-0315f421d685 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:02.384486 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-957a597b-00ee-4dd1-8a90-0315f421d685 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:02.386647 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-957a597b-00ee-4dd1-8a90-0315f421d685 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:02.389740 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-957a597b-00ee-4dd1-8a90-0315f421d685 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:02.391310 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-957a597b-00ee-4dd1-8a90-0315f421d685 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:02.392442 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-957a597b-00ee-4dd1-8a90-0315f421d685 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:02.663698 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-957a597b-00ee-4dd1-8a90-0315f421d685 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:02.688640 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-957a597b-00ee-4dd1-8a90-0315f421d685 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1552 microversion: 2.1 time: 0.325774 Aug 31 12:31:02.702578 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 86/157] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:02 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1552 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:02.724794 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-21940b21-2db2-445d-8673-b7eb4de82f8c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:02.726809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-21940b21-2db2-445d-8673-b7eb4de82f8c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:02.760235 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-21940b21-2db2-445d-8673-b7eb4de82f8c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:02.761530 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-21940b21-2db2-445d-8673-b7eb4de82f8c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:02.762901 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-21940b21-2db2-445d-8673-b7eb4de82f8c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:02.765754 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-21940b21-2db2-445d-8673-b7eb4de82f8c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:02.768647 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-21940b21-2db2-445d-8673-b7eb4de82f8c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:02.769654 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-21940b21-2db2-445d-8673-b7eb4de82f8c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:03.285836 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-21940b21-2db2-445d-8673-b7eb4de82f8c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:03.301100 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-21940b21-2db2-445d-8673-b7eb4de82f8c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.582861 Aug 31 12:31:03.302109 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 72/158] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:02 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:03.624593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-2ea608bc-12ab-44a8-8e66-808cfb820051 req-94d2f6bc-359c-4903-babc-de83809758e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3490a556-866f-470d-953a-dab05d45e9e6", "name": "network-vif-deleted", "tag": "0a707636-801a-41c6-8d9a-d69739984b5b"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:31:03.635891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-2ea608bc-12ab-44a8-8e66-808cfb820051 req-94d2f6bc-359c-4903-babc-de83809758e7 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:03.636682 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-2ea608bc-12ab-44a8-8e66-808cfb820051 req-94d2f6bc-359c-4903-babc-de83809758e7 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:03.636999 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-2ea608bc-12ab-44a8-8e66-808cfb820051 req-94d2f6bc-359c-4903-babc-de83809758e7 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:03.653085 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-2ea608bc-12ab-44a8-8e66-808cfb820051 req-94d2f6bc-359c-4903-babc-de83809758e7 service nova] Creating event network-vif-deleted:0a707636-801a-41c6-8d9a-d69739984b5b for instance 3490a556-866f-470d-953a-dab05d45e9e6 on hv-cinder-85528 Aug 31 12:31:03.659459 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-2ea608bc-12ab-44a8-8e66-808cfb820051 req-94d2f6bc-359c-4903-babc-de83809758e7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038668 Aug 31 12:31:03.661271 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 87/159] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:31:03.711157 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-c36ba765-2f08-4b4f-8765-26c49b0005dc tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:03.712322 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-c36ba765-2f08-4b4f-8765-26c49b0005dc tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:03.725744 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c36ba765-2f08-4b4f-8765-26c49b0005dc tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:03.731863 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c36ba765-2f08-4b4f-8765-26c49b0005dc tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:03.732761 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c36ba765-2f08-4b4f-8765-26c49b0005dc tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:03.734339 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c36ba765-2f08-4b4f-8765-26c49b0005dc tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:03.735261 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c36ba765-2f08-4b4f-8765-26c49b0005dc tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:03.735984 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c36ba765-2f08-4b4f-8765-26c49b0005dc tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:03.841471 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-c36ba765-2f08-4b4f-8765-26c49b0005dc tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:03.860036 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-c36ba765-2f08-4b4f-8765-26c49b0005dc tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1345 microversion: 2.1 time: 0.153967 Aug 31 12:31:03.861187 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 73/160] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:03 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1345 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:04.336990 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-cd4e4f5e-77a2-4fcd-b4a8-32076d657a31 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:04.337925 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-cd4e4f5e-77a2-4fcd-b4a8-32076d657a31 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:04.345187 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cd4e4f5e-77a2-4fcd-b4a8-32076d657a31 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:04.345987 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cd4e4f5e-77a2-4fcd-b4a8-32076d657a31 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:04.346658 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cd4e4f5e-77a2-4fcd-b4a8-32076d657a31 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:04.348037 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cd4e4f5e-77a2-4fcd-b4a8-32076d657a31 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:04.348831 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cd4e4f5e-77a2-4fcd-b4a8-32076d657a31 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:04.349725 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cd4e4f5e-77a2-4fcd-b4a8-32076d657a31 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:04.588592 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-cd4e4f5e-77a2-4fcd-b4a8-32076d657a31 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:04.608479 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-cd4e4f5e-77a2-4fcd-b4a8-32076d657a31 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.275051 Aug 31 12:31:04.609966 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 88/161] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:04 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:04.905009 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-773654cf-ffb5-4ce3-9057-d5f77c61b849 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:04.905702 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-773654cf-ffb5-4ce3-9057-d5f77c61b849 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:04.913308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-773654cf-ffb5-4ce3-9057-d5f77c61b849 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:04.914021 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-773654cf-ffb5-4ce3-9057-d5f77c61b849 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:04.914845 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-773654cf-ffb5-4ce3-9057-d5f77c61b849 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:04.915598 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-773654cf-ffb5-4ce3-9057-d5f77c61b849 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:04.916056 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-773654cf-ffb5-4ce3-9057-d5f77c61b849 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:04.916468 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-773654cf-ffb5-4ce3-9057-d5f77c61b849 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:04.986590 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-773654cf-ffb5-4ce3-9057-d5f77c61b849 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:04.988024 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-773654cf-ffb5-4ce3-9057-d5f77c61b849 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:04.989757 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-773654cf-ffb5-4ce3-9057-d5f77c61b849 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:04.991707 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.objects.instance [None req-773654cf-ffb5-4ce3-9057-d5f77c61b849 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lazy-loading 'fault' on Instance uuid 3490a556-866f-470d-953a-dab05d45e9e6 {{(pid=120750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:31:05.079123 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-773654cf-ffb5-4ce3-9057-d5f77c61b849 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8a3ebaaec7442039ecda2d63c54cc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cc2121d964451892be22fdcdd78b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:05.098353 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-773654cf-ffb5-4ce3-9057-d5f77c61b849 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 200 len: 1304 microversion: 2.1 time: 0.201742 Aug 31 12:31:05.099532 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 74/162] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:04 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 1304 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:05.634574 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-79fcb0a4-0475-4e78-96cb-2f7bb70d34f7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:05.635488 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-79fcb0a4-0475-4e78-96cb-2f7bb70d34f7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:05.647393 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-79fcb0a4-0475-4e78-96cb-2f7bb70d34f7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:05.647897 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-79fcb0a4-0475-4e78-96cb-2f7bb70d34f7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:05.648342 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-79fcb0a4-0475-4e78-96cb-2f7bb70d34f7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:05.649077 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-79fcb0a4-0475-4e78-96cb-2f7bb70d34f7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:05.650943 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-79fcb0a4-0475-4e78-96cb-2f7bb70d34f7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:05.650943 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-79fcb0a4-0475-4e78-96cb-2f7bb70d34f7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:05.861715 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-79fcb0a4-0475-4e78-96cb-2f7bb70d34f7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:05.873023 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-79fcb0a4-0475-4e78-96cb-2f7bb70d34f7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.244085 Aug 31 12:31:05.873697 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 89/163] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:05 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:31:06.128370 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-667865c2-b3d4-4637-9653-57e02d1d04d5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:06.129199 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-667865c2-b3d4-4637-9653-57e02d1d04d5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:06.137410 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-667865c2-b3d4-4637-9653-57e02d1d04d5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:06.141023 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-667865c2-b3d4-4637-9653-57e02d1d04d5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:06.141023 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-667865c2-b3d4-4637-9653-57e02d1d04d5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:06.141023 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-667865c2-b3d4-4637-9653-57e02d1d04d5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:06.141671 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-667865c2-b3d4-4637-9653-57e02d1d04d5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:06.142846 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-667865c2-b3d4-4637-9653-57e02d1d04d5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:06.166966 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-667865c2-b3d4-4637-9653-57e02d1d04d5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] HTTP exception thrown: Instance 3490a556-866f-470d-953a-dab05d45e9e6 could not be found. Aug 31 12:31:06.183462 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-667865c2-b3d4-4637-9653-57e02d1d04d5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Request method failure captured: Aug 31 12:31:06.183462 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 HTTP/1.1 Aug 31 12:31:06.183462 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:31:06.183462 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:31:06.183462 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:31:06.183462 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 0 Aug 31 12:31:06.183462 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:31:06.183462 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:31:06.183462 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:31:06.183462 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:31:06.183462 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1Q_EtH6FjXrvEABQr0NXyFMeeWBjSgWrsz5o5vy2JXWd78DLpnOy1-5ci-M7ZqSXVm5_tLYy8M33hrLY8K6JeSfqVJVWtMWJ37fb-x5SmxVzAwZJjrAb3jqZz2Iwp0p8e5DArNL_f72C_zn4YqYu2dO-SGwqSVVbel5E-uxOla8_Z0 Aug 31 12:31:06.183462 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:31:06.183462 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:31:06.183462 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:31:06.183462 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:31:06.183462 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:31:06.183462 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:31:06.183462 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: 67cc2121d964451892be22fdcdd78b63 Aug 31 12:31:06.183462 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-DeleteServersTestJSON-1473640490 Aug 31 12:31:06.183462 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:31:06.183462 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:31:06.185943 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/67cc2121d964451892be22fdcdd78b63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_67cc2121d964451892be22fdcdd78b63", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67cc2121d964451892be22fdcdd78b63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67cc2121d964451892be22fdcdd78b63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:31:06.185943 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-DeleteServersTestJSON-1473640490 Aug 31 12:31:06.185943 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: 67cc2121d964451892be22fdcdd78b63 Aug 31 12:31:06.185943 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-DeleteServersTestJSON-1473640490 Aug 31 12:31:06.185943 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-DeleteServersTestJSON-1473640490-project Aug 31 12:31:06.185943 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:31:06.185943 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:31:06.185943 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: f8a3ebaaec7442039ecda2d63c54cc59 Aug 31 12:31:06.185943 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-DeleteServersTestJSON-1473640490-project Aug 31 12:31:06.185943 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:31:06.185943 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Instance 3490a556-866f-470d-953a-dab05d45e9e6 could not be found. Aug 31 12:31:06.185943 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'id': '3490a556-866f-470d-953a-dab05d45e9e6'} Aug 31 12:31:06.187585 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:31:06.187585 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:31:06.187585 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:31:06.187585 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:31:06.187585 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:31:06.187585 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:31:06.187585 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:31:06.187585 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:31:06.187585 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:31:06.187585 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:31:06.187585 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3490a556-866f-470d-953a-dab05d45e9e6 could not be found. Aug 31 12:31:06.187585 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:31:06.187585 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:31:06.187585 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:31:06.187585 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:31:06.187585 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:31:06.187585 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:31:06.187585 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:31:06.187585 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:31:06.187585 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:31:06.190009 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:31:06.190009 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:31:06.190009 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:31:06.190009 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:31:06.190009 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:31:06.190009 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:31:06.190009 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:31:06.190009 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3490a556-866f-470d-953a-dab05d45e9e6 could not be found. Aug 31 12:31:06.190009 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:31:06.190009 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:31:06.190009 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:31:06.190009 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:31:06.190009 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:31:06.190009 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:31:06.190009 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:31:06.190009 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:31:06.190009 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3490a556-866f-470d-953a-dab05d45e9e6 could not be found. Aug 31 12:31:06.190009 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:31:06.192302 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-667865c2-b3d4-4637-9653-57e02d1d04d5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Returning 404 to user: Instance 3490a556-866f-470d-953a-dab05d45e9e6 could not be found. {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:31:06.192302 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-667865c2-b3d4-4637-9653-57e02d1d04d5 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 404 len: 111 microversion: 2.1 time: 0.061114 Aug 31 12:31:06.192302 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 75/164] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:06 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:31:06.358168 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-8ab37e27-29d2-488e-9b05-eb9be0e29b11 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:06.361998 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-8ab37e27-29d2-488e-9b05-eb9be0e29b11 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:06.371630 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8ab37e27-29d2-488e-9b05-eb9be0e29b11 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:06.372127 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8ab37e27-29d2-488e-9b05-eb9be0e29b11 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:06.372821 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8ab37e27-29d2-488e-9b05-eb9be0e29b11 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:06.374021 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8ab37e27-29d2-488e-9b05-eb9be0e29b11 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:06.374783 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8ab37e27-29d2-488e-9b05-eb9be0e29b11 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:06.375409 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8ab37e27-29d2-488e-9b05-eb9be0e29b11 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:06.401533 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.wsgi [None req-8ab37e27-29d2-488e-9b05-eb9be0e29b11 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] HTTP exception thrown: Instance 3490a556-866f-470d-953a-dab05d45e9e6 could not be found. Aug 31 12:31:06.409514 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-8ab37e27-29d2-488e-9b05-eb9be0e29b11 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Request method failure captured: Aug 31 12:31:06.409514 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: request: GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6/os-volume_attachments HTTP/1.1 Aug 31 12:31:06.409514 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept: application/json Aug 31 12:31:06.409514 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept-Encoding: identity Aug 31 12:31:06.409514 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Connection: close Aug 31 12:31:06.409514 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Length: 0 Aug 31 12:31:06.409514 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Type: application/json Aug 31 12:31:06.409514 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Host: 10.222.0.79 Aug 31 12:31:06.409514 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Openstack-System-Scope: None Aug 31 12:31:06.409514 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: User-Agent: python-urllib3/1.26.12 Aug 31 12:31:06.409514 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Auth-Token: gAAAAABjD1Q_EtH6FjXrvEABQr0NXyFMeeWBjSgWrsz5o5vy2JXWd78DLpnOy1-5ci-M7ZqSXVm5_tLYy8M33hrLY8K6JeSfqVJVWtMWJ37fb-x5SmxVzAwZJjrAb3jqZz2Iwp0p8e5DArNL_f72C_zn4YqYu2dO-SGwqSVVbel5E-uxOla8_Z0 Aug 31 12:31:06.409514 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Id: None Aug 31 12:31:06.409514 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Name: None Aug 31 12:31:06.409514 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Identity-Status: Confirmed Aug 31 12:31:06.409514 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Is-Admin-Project: True Aug 31 12:31:06.409514 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Id: default Aug 31 12:31:06.409514 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Name: Default Aug 31 12:31:06.409514 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Id: 67cc2121d964451892be22fdcdd78b63 Aug 31 12:31:06.409514 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Name: tempest-DeleteServersTestJSON-1473640490 Aug 31 12:31:06.409514 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Role: reader,member Aug 31 12:31:06.409514 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Roles: reader,member Aug 31 12:31:06.411345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/67cc2121d964451892be22fdcdd78b63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_67cc2121d964451892be22fdcdd78b63", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67cc2121d964451892be22fdcdd78b63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67cc2121d964451892be22fdcdd78b63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:31:06.411345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant: tempest-DeleteServersTestJSON-1473640490 Aug 31 12:31:06.411345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Id: 67cc2121d964451892be22fdcdd78b63 Aug 31 12:31:06.411345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Name: tempest-DeleteServersTestJSON-1473640490 Aug 31 12:31:06.411345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User: tempest-DeleteServersTestJSON-1473640490-project Aug 31 12:31:06.411345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Id: default Aug 31 12:31:06.411345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Name: Default Aug 31 12:31:06.411345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Id: f8a3ebaaec7442039ecda2d63c54cc59 Aug 31 12:31:06.411345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Name: tempest-DeleteServersTestJSON-1473640490-project Aug 31 12:31:06.411345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: method: > Aug 31 12:31:06.411345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: exception: Instance 3490a556-866f-470d-953a-dab05d45e9e6 could not be found. Aug 31 12:31:06.411345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: action_args: {'server_id': '3490a556-866f-470d-953a-dab05d45e9e6'} Aug 31 12:31:06.412284 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:31:06.412284 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:31:06.412284 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:31:06.412284 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:31:06.412284 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:31:06.412284 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:31:06.412284 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:31:06.412284 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:31:06.412284 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:31:06.412284 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:31:06.412284 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3490a556-866f-470d-953a-dab05d45e9e6 could not be found. Aug 31 12:31:06.412284 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:06.412284 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:31:06.412284 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:06.412284 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:31:06.412284 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:31:06.412284 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:31:06.412284 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:31:06.412284 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:31:06.412284 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:31:06.413960 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:31:06.413960 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 12:31:06.413960 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 12:31:06.413960 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 12:31:06.413960 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 12:31:06.413960 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 31 12:31:06.413960 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 31 12:31:06.413960 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:31:06.413960 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:31:06.413960 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3490a556-866f-470d-953a-dab05d45e9e6 could not be found. Aug 31 12:31:06.413960 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:06.413960 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:31:06.413960 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:06.413960 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:31:06.413960 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:31:06.413960 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:31:06.413960 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:31:06.413960 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:31:06.413960 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3490a556-866f-470d-953a-dab05d45e9e6 could not be found. Aug 31 12:31:06.413960 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:06.415424 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-8ab37e27-29d2-488e-9b05-eb9be0e29b11 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Returning 404 to user: Instance 3490a556-866f-470d-953a-dab05d45e9e6 could not be found. {{(pid=120749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:31:06.415424 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-8ab37e27-29d2-488e-9b05-eb9be0e29b11 tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.060391 Aug 31 12:31:06.415424 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 90/165] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 31 12:31:06 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6/os-volume_attachments => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:31:06.899469 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-fc781333-6fd7-4e6d-b79f-d9648bba7185 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:06.900477 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-fc781333-6fd7-4e6d-b79f-d9648bba7185 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:06.909015 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fc781333-6fd7-4e6d-b79f-d9648bba7185 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:06.909965 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fc781333-6fd7-4e6d-b79f-d9648bba7185 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:06.910559 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fc781333-6fd7-4e6d-b79f-d9648bba7185 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:06.911623 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fc781333-6fd7-4e6d-b79f-d9648bba7185 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:06.912233 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fc781333-6fd7-4e6d-b79f-d9648bba7185 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:06.912836 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fc781333-6fd7-4e6d-b79f-d9648bba7185 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:07.126965 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-fc781333-6fd7-4e6d-b79f-d9648bba7185 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:07.141407 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-fc781333-6fd7-4e6d-b79f-d9648bba7185 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.247063 Aug 31 12:31:07.142402 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 76/166] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:06 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:07.730275 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-83f67c45-ed47-468b-94a3-50ad726e60be tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:07.731176 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-83f67c45-ed47-468b-94a3-50ad726e60be tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:07.738140 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-83f67c45-ed47-468b-94a3-50ad726e60be tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:07.738639 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-83f67c45-ed47-468b-94a3-50ad726e60be tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:07.739114 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-83f67c45-ed47-468b-94a3-50ad726e60be tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:07.739860 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-83f67c45-ed47-468b-94a3-50ad726e60be tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:07.740319 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-83f67c45-ed47-468b-94a3-50ad726e60be tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:07.740748 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-83f67c45-ed47-468b-94a3-50ad726e60be tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:07.757500 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.wsgi [None req-83f67c45-ed47-468b-94a3-50ad726e60be tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] HTTP exception thrown: Instance 3490a556-866f-470d-953a-dab05d45e9e6 could not be found. Aug 31 12:31:07.759888 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-83f67c45-ed47-468b-94a3-50ad726e60be tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Request method failure captured: Aug 31 12:31:07.759888 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: request: DELETE /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 HTTP/1.1 Aug 31 12:31:07.759888 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept: application/json Aug 31 12:31:07.759888 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept-Encoding: identity Aug 31 12:31:07.759888 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Connection: close Aug 31 12:31:07.759888 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Length: 0 Aug 31 12:31:07.759888 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Type: application/json Aug 31 12:31:07.759888 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Host: 10.222.0.79 Aug 31 12:31:07.759888 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Openstack-System-Scope: None Aug 31 12:31:07.759888 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: User-Agent: python-urllib3/1.26.12 Aug 31 12:31:07.759888 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Auth-Token: gAAAAABjD1Q_EtH6FjXrvEABQr0NXyFMeeWBjSgWrsz5o5vy2JXWd78DLpnOy1-5ci-M7ZqSXVm5_tLYy8M33hrLY8K6JeSfqVJVWtMWJ37fb-x5SmxVzAwZJjrAb3jqZz2Iwp0p8e5DArNL_f72C_zn4YqYu2dO-SGwqSVVbel5E-uxOla8_Z0 Aug 31 12:31:07.759888 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Id: None Aug 31 12:31:07.759888 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Name: None Aug 31 12:31:07.759888 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Identity-Status: Confirmed Aug 31 12:31:07.759888 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Is-Admin-Project: True Aug 31 12:31:07.759888 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Id: default Aug 31 12:31:07.759888 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Name: Default Aug 31 12:31:07.759888 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Id: 67cc2121d964451892be22fdcdd78b63 Aug 31 12:31:07.759888 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Name: tempest-DeleteServersTestJSON-1473640490 Aug 31 12:31:07.759888 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Role: reader,member Aug 31 12:31:07.759888 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Roles: reader,member Aug 31 12:31:07.762793 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/67cc2121d964451892be22fdcdd78b63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_67cc2121d964451892be22fdcdd78b63", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67cc2121d964451892be22fdcdd78b63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67cc2121d964451892be22fdcdd78b63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:31:07.762793 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant: tempest-DeleteServersTestJSON-1473640490 Aug 31 12:31:07.762793 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Id: 67cc2121d964451892be22fdcdd78b63 Aug 31 12:31:07.762793 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Name: tempest-DeleteServersTestJSON-1473640490 Aug 31 12:31:07.762793 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User: tempest-DeleteServersTestJSON-1473640490-project Aug 31 12:31:07.762793 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Id: default Aug 31 12:31:07.762793 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Name: Default Aug 31 12:31:07.762793 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Id: f8a3ebaaec7442039ecda2d63c54cc59 Aug 31 12:31:07.762793 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Name: tempest-DeleteServersTestJSON-1473640490-project Aug 31 12:31:07.762793 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: method: > Aug 31 12:31:07.762793 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: exception: Instance 3490a556-866f-470d-953a-dab05d45e9e6 could not be found. Aug 31 12:31:07.762793 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: action_args: {'id': '3490a556-866f-470d-953a-dab05d45e9e6'} Aug 31 12:31:07.763524 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:31:07.763524 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:31:07.763524 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:31:07.763524 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:31:07.763524 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:31:07.763524 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:31:07.763524 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:31:07.763524 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:31:07.763524 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:31:07.763524 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:31:07.763524 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3490a556-866f-470d-953a-dab05d45e9e6 could not be found. Aug 31 12:31:07.763524 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:07.763524 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:31:07.763524 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:07.763524 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:31:07.763524 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:31:07.763524 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:31:07.763524 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:31:07.763524 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:31:07.763524 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:31:07.764831 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:31:07.764831 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 12:31:07.764831 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 12:31:07.764831 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 12:31:07.764831 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 12:31:07.764831 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:31:07.764831 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:31:07.764831 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:31:07.764831 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:31:07.764831 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3490a556-866f-470d-953a-dab05d45e9e6 could not be found. Aug 31 12:31:07.764831 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:07.764831 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:31:07.764831 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:07.764831 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:31:07.764831 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:31:07.764831 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:31:07.764831 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:31:07.764831 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:31:07.764831 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3490a556-866f-470d-953a-dab05d45e9e6 could not be found. Aug 31 12:31:07.764831 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:07.766476 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-83f67c45-ed47-468b-94a3-50ad726e60be tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Returning 404 to user: Instance 3490a556-866f-470d-953a-dab05d45e9e6 could not be found. {{(pid=120749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:31:07.766476 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-83f67c45-ed47-468b-94a3-50ad726e60be tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 404 len: 111 microversion: 2.1 time: 0.035501 Aug 31 12:31:07.766476 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 91/167] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 31 12:31:07 2022] DELETE /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:31:07.771616 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-de568add-0d93-4d5e-880b-219a2905511d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:07.772253 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-de568add-0d93-4d5e-880b-219a2905511d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] [instance: 3490a556-866f-470d-953a-dab05d45e9e6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:07.778773 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-de568add-0d93-4d5e-880b-219a2905511d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:07.779279 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-de568add-0d93-4d5e-880b-219a2905511d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:07.779707 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-de568add-0d93-4d5e-880b-219a2905511d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:07.780409 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-de568add-0d93-4d5e-880b-219a2905511d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:07.780859 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-de568add-0d93-4d5e-880b-219a2905511d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:07.781278 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-de568add-0d93-4d5e-880b-219a2905511d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:07.798148 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-de568add-0d93-4d5e-880b-219a2905511d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] HTTP exception thrown: Instance 3490a556-866f-470d-953a-dab05d45e9e6 could not be found. Aug 31 12:31:07.799723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-de568add-0d93-4d5e-880b-219a2905511d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Request method failure captured: Aug 31 12:31:07.799723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 HTTP/1.1 Aug 31 12:31:07.799723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:31:07.799723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:31:07.799723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:31:07.799723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 0 Aug 31 12:31:07.799723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:31:07.799723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:31:07.799723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:31:07.799723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:31:07.799723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1Q_EtH6FjXrvEABQr0NXyFMeeWBjSgWrsz5o5vy2JXWd78DLpnOy1-5ci-M7ZqSXVm5_tLYy8M33hrLY8K6JeSfqVJVWtMWJ37fb-x5SmxVzAwZJjrAb3jqZz2Iwp0p8e5DArNL_f72C_zn4YqYu2dO-SGwqSVVbel5E-uxOla8_Z0 Aug 31 12:31:07.799723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:31:07.799723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:31:07.799723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:31:07.799723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:31:07.799723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:31:07.799723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:31:07.799723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: 67cc2121d964451892be22fdcdd78b63 Aug 31 12:31:07.799723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-DeleteServersTestJSON-1473640490 Aug 31 12:31:07.799723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:31:07.799723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:31:07.802349 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/67cc2121d964451892be22fdcdd78b63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_67cc2121d964451892be22fdcdd78b63", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67cc2121d964451892be22fdcdd78b63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67cc2121d964451892be22fdcdd78b63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:31:07.802349 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-DeleteServersTestJSON-1473640490 Aug 31 12:31:07.802349 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: 67cc2121d964451892be22fdcdd78b63 Aug 31 12:31:07.802349 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-DeleteServersTestJSON-1473640490 Aug 31 12:31:07.802349 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-DeleteServersTestJSON-1473640490-project Aug 31 12:31:07.802349 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:31:07.802349 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:31:07.802349 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: f8a3ebaaec7442039ecda2d63c54cc59 Aug 31 12:31:07.802349 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-DeleteServersTestJSON-1473640490-project Aug 31 12:31:07.802349 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:31:07.802349 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Instance 3490a556-866f-470d-953a-dab05d45e9e6 could not be found. Aug 31 12:31:07.802349 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'id': '3490a556-866f-470d-953a-dab05d45e9e6'} Aug 31 12:31:07.804018 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:31:07.804018 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:31:07.804018 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:31:07.804018 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:31:07.804018 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:31:07.804018 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:31:07.804018 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:31:07.804018 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:31:07.804018 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:31:07.804018 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:31:07.804018 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3490a556-866f-470d-953a-dab05d45e9e6 could not be found. Aug 31 12:31:07.804018 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:31:07.804018 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:31:07.804018 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:31:07.804018 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:31:07.804018 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:31:07.804018 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:31:07.804018 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:31:07.804018 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:31:07.804018 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:31:07.806164 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:31:07.806164 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:31:07.806164 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:31:07.806164 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:31:07.806164 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:31:07.806164 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:31:07.806164 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:31:07.806164 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3490a556-866f-470d-953a-dab05d45e9e6 could not be found. Aug 31 12:31:07.806164 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:31:07.806164 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:31:07.806164 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:31:07.806164 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:31:07.806164 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:31:07.806164 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:31:07.806164 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:31:07.806164 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:31:07.806164 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3490a556-866f-470d-953a-dab05d45e9e6 could not be found. Aug 31 12:31:07.806164 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:31:07.809187 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-de568add-0d93-4d5e-880b-219a2905511d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] Returning 404 to user: Instance 3490a556-866f-470d-953a-dab05d45e9e6 could not be found. {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:31:07.809187 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-de568add-0d93-4d5e-880b-219a2905511d tempest-DeleteServersTestJSON-1473640490 tempest-DeleteServersTestJSON-1473640490-project] 10.222.0.79 "GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6" status: 404 len: 111 microversion: 2.1 time: 0.033524 Aug 31 12:31:07.809187 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 77/168] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:07 2022] GET /compute/v2.1/servers/3490a556-866f-470d-953a-dab05d45e9e6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:31:08.169194 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-78d0c97e-03fa-41e4-870e-bf8459d49d99 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:08.170291 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-78d0c97e-03fa-41e4-870e-bf8459d49d99 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:08.178449 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-78d0c97e-03fa-41e4-870e-bf8459d49d99 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:08.179301 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-78d0c97e-03fa-41e4-870e-bf8459d49d99 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:08.180146 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-78d0c97e-03fa-41e4-870e-bf8459d49d99 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:08.181191 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-78d0c97e-03fa-41e4-870e-bf8459d49d99 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:08.181811 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-78d0c97e-03fa-41e4-870e-bf8459d49d99 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:08.182605 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-78d0c97e-03fa-41e4-870e-bf8459d49d99 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:08.540826 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-78d0c97e-03fa-41e4-870e-bf8459d49d99 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:08.558712 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-78d0c97e-03fa-41e4-870e-bf8459d49d99 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.394844 Aug 31 12:31:08.561159 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 92/169] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:08 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:09.593241 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-8dda55db-eb07-41a2-89b9-d0821417e01c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:09.594082 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-8dda55db-eb07-41a2-89b9-d0821417e01c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:09.604541 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8dda55db-eb07-41a2-89b9-d0821417e01c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:09.606501 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8dda55db-eb07-41a2-89b9-d0821417e01c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:09.607261 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8dda55db-eb07-41a2-89b9-d0821417e01c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:09.608132 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8dda55db-eb07-41a2-89b9-d0821417e01c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:09.608931 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8dda55db-eb07-41a2-89b9-d0821417e01c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:09.609536 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8dda55db-eb07-41a2-89b9-d0821417e01c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:09.879781 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-8dda55db-eb07-41a2-89b9-d0821417e01c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:09.891207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-8dda55db-eb07-41a2-89b9-d0821417e01c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.306863 Aug 31 12:31:09.891976 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 78/170] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:09 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:10.926204 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-3063caff-3025-4e00-8766-3529a9a82ea2 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:10.927259 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-3063caff-3025-4e00-8766-3529a9a82ea2 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:10.936305 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3063caff-3025-4e00-8766-3529a9a82ea2 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:10.936808 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3063caff-3025-4e00-8766-3529a9a82ea2 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:10.937331 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3063caff-3025-4e00-8766-3529a9a82ea2 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:10.938051 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3063caff-3025-4e00-8766-3529a9a82ea2 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:10.938488 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3063caff-3025-4e00-8766-3529a9a82ea2 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:10.938948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3063caff-3025-4e00-8766-3529a9a82ea2 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:11.206030 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-3063caff-3025-4e00-8766-3529a9a82ea2 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:11.225430 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-3063caff-3025-4e00-8766-3529a9a82ea2 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.306559 Aug 31 12:31:11.226045 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 93/171] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:10 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:12.249888 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-589bcd4c-180c-4ec3-8f98-3bc06e52a988 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:12.251218 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-589bcd4c-180c-4ec3-8f98-3bc06e52a988 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:12.258520 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-589bcd4c-180c-4ec3-8f98-3bc06e52a988 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:12.259375 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-589bcd4c-180c-4ec3-8f98-3bc06e52a988 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:12.259805 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-589bcd4c-180c-4ec3-8f98-3bc06e52a988 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:12.260595 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-589bcd4c-180c-4ec3-8f98-3bc06e52a988 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:12.261354 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-589bcd4c-180c-4ec3-8f98-3bc06e52a988 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:12.261769 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-589bcd4c-180c-4ec3-8f98-3bc06e52a988 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:12.798998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-589bcd4c-180c-4ec3-8f98-3bc06e52a988 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:12.814304 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-589bcd4c-180c-4ec3-8f98-3bc06e52a988 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.568199 Aug 31 12:31:12.816034 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 79/172] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:12 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:13.841020 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-285fbf33-bc65-4280-8892-47c4bbd6ce4b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:13.842321 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-285fbf33-bc65-4280-8892-47c4bbd6ce4b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:13.850336 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_api:SELECT=52 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:13.860102 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-285fbf33-bc65-4280-8892-47c4bbd6ce4b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:13.861458 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-285fbf33-bc65-4280-8892-47c4bbd6ce4b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:13.862613 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-285fbf33-bc65-4280-8892-47c4bbd6ce4b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:13.864358 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-285fbf33-bc65-4280-8892-47c4bbd6ce4b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:13.865211 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-285fbf33-bc65-4280-8892-47c4bbd6ce4b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:13.865992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-285fbf33-bc65-4280-8892-47c4bbd6ce4b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:14.042001 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-285fbf33-bc65-4280-8892-47c4bbd6ce4b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:14.053460 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-285fbf33-bc65-4280-8892-47c4bbd6ce4b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.219666 Aug 31 12:31:14.054154 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 94/173] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:13 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:14.478631 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-e613f28c-f8af-4f7f-8b1d-abd652cd8170 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] Action: 'create', calling method: .version_select at 0x7f8d172b3670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1460936414"}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:31:14.941449 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-e613f28c-f8af-4f7f-8b1d-abd652cd8170 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.606956 Aug 31 12:31:14.943417 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 80/174] 10.222.0.79 () {60 vars in 1155 bytes} [Wed Aug 31 12:31:14 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 610 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 12:31:14.957045 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-9cb361e9-cc07-476d-a283-c89f6b0b01f5 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] Calling method '.version_select at 0x7f8d17232430>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:15.078007 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-0f808573-1b30-4470-8340-090a3b8b9a93 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:15.079141 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-0f808573-1b30-4470-8340-090a3b8b9a93 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:15.086005 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0f808573-1b30-4470-8340-090a3b8b9a93 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:15.086503 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0f808573-1b30-4470-8340-090a3b8b9a93 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:15.087012 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0f808573-1b30-4470-8340-090a3b8b9a93 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:15.087919 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0f808573-1b30-4470-8340-090a3b8b9a93 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:15.088400 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0f808573-1b30-4470-8340-090a3b8b9a93 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:15.089799 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0f808573-1b30-4470-8340-090a3b8b9a93 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:15.093052 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-9cb361e9-cc07-476d-a283-c89f6b0b01f5 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/926de173-e555-446e-8460-a1292e66945c" status: 200 len: 345 microversion: 2.1 time: 0.140352 Aug 31 12:31:15.093581 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 95/175] 10.222.0.79 () {58 vars in 1245 bytes} [Wed Aug 31 12:31:14 2022] GET /compute/v2.1/os-volumes/926de173-e555-446e-8460-a1292e66945c => generated 345 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:31:15.102081 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:15.256002 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-0f808573-1b30-4470-8340-090a3b8b9a93 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:15.266736 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-0f808573-1b30-4470-8340-090a3b8b9a93 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.193240 Aug 31 12:31:15.267363 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 81/176] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:15 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:16.112063 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-3835bf3a-ab8e-4cab-8064-1ccca2cf8007 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] Calling method '.version_select at 0x7f8d172598b0>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:16.167129 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-3835bf3a-ab8e-4cab-8064-1ccca2cf8007 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/926de173-e555-446e-8460-a1292e66945c" status: 200 len: 346 microversion: 2.1 time: 0.062287 Aug 31 12:31:16.178775 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 96/177] 10.222.0.79 () {58 vars in 1245 bytes} [Wed Aug 31 12:31:16 2022] GET /compute/v2.1/os-volumes/926de173-e555-446e-8460-a1292e66945c => generated 346 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:31:16.187206 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-2a79ccdd-186e-4f64-81d4-b4878b9ded54 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] Action: 'create', calling method: .version_select at 0x7f8d17fe1f70>, body: {"snapshot": {"volume_id": "926de173-e555-446e-8460-a1292e66945c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1992760978"}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:31:16.290375 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-eaa92dc8-78a8-4448-8823-b328ee8c8f76 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:16.291581 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-eaa92dc8-78a8-4448-8823-b328ee8c8f76 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:16.299396 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-eaa92dc8-78a8-4448-8823-b328ee8c8f76 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:16.300181 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-eaa92dc8-78a8-4448-8823-b328ee8c8f76 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:16.300815 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-eaa92dc8-78a8-4448-8823-b328ee8c8f76 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:16.301830 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-eaa92dc8-78a8-4448-8823-b328ee8c8f76 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:16.302301 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-eaa92dc8-78a8-4448-8823-b328ee8c8f76 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:16.302736 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-eaa92dc8-78a8-4448-8823-b328ee8c8f76 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:16.484259 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-2a79ccdd-186e-4f64-81d4-b4878b9ded54 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] 10.222.0.79 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.302522 Aug 31 12:31:16.489487 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 82/178] 10.222.0.79 () {60 vars in 1162 bytes} [Wed Aug 31 12:31:16 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:31:16.510271 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-3f69195e-7c98-41c6-b127-eb1b60bbedb9 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] Calling method '.version_select at 0x7f8d172b3550>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:16.629777 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-eaa92dc8-78a8-4448-8823-b328ee8c8f76 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:16.632131 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-3f69195e-7c98-41c6-b127-eb1b60bbedb9 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/25fe0d39-7527-41a9-8650-2b1fd853f98c" status: 200 len: 287 microversion: 2.1 time: 0.099560 Aug 31 12:31:16.642891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 83/179] 10.222.0.79 () {58 vars in 1251 bytes} [Wed Aug 31 12:31:16 2022] GET /compute/v2.1/os-snapshots/25fe0d39-7527-41a9-8650-2b1fd853f98c => generated 287 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:31:16.656710 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-947db50e-9f69-494f-bf92-b3beb8779d11 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] Calling method '.version_select at 0x7f8d172c40d0>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:16.670947 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-eaa92dc8-78a8-4448-8823-b328ee8c8f76 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.384970 Aug 31 12:31:16.671998 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 97/180] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:16 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:31:16.725288 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-947db50e-9f69-494f-bf92-b3beb8779d11 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.078057 Aug 31 12:31:16.727044 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 84/181] 10.222.0.79 () {58 vars in 1140 bytes} [Wed Aug 31 12:31:16 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:31:16.750015 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-a4cde7da-0007-4f4c-8f60-e442d353ee7c tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] Calling method '.version_select at 0x7f8d17232dc0>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:16.806394 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-a4cde7da-0007-4f4c-8f60-e442d353ee7c tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/25fe0d39-7527-41a9-8650-2b1fd853f98c" status: 200 len: 287 microversion: 2.1 time: 0.063279 Aug 31 12:31:16.806394 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 98/182] 10.222.0.79 () {58 vars in 1251 bytes} [Wed Aug 31 12:31:16 2022] GET /compute/v2.1/os-snapshots/25fe0d39-7527-41a9-8650-2b1fd853f98c => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:31:17.694945 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-c82bea55-d779-4982-9e0b-5335f843f6a8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:17.695742 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-c82bea55-d779-4982-9e0b-5335f843f6a8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:17.705582 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c82bea55-d779-4982-9e0b-5335f843f6a8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:17.706073 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c82bea55-d779-4982-9e0b-5335f843f6a8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:17.706568 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c82bea55-d779-4982-9e0b-5335f843f6a8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:17.707426 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c82bea55-d779-4982-9e0b-5335f843f6a8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:17.707961 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c82bea55-d779-4982-9e0b-5335f843f6a8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:17.708450 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c82bea55-d779-4982-9e0b-5335f843f6a8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:17.828649 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-6ec4ebb5-a896-402f-84d0-08367fcfddd9 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] Calling method '.version_select at 0x7f8d172281f0>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:17.873316 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-c82bea55-d779-4982-9e0b-5335f843f6a8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:17.878983 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-6ec4ebb5-a896-402f-84d0-08367fcfddd9 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/25fe0d39-7527-41a9-8650-2b1fd853f98c" status: 200 len: 287 microversion: 2.1 time: 0.059043 Aug 31 12:31:17.880098 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 99/183] 10.222.0.79 () {58 vars in 1251 bytes} [Wed Aug 31 12:31:17 2022] GET /compute/v2.1/os-snapshots/25fe0d39-7527-41a9-8650-2b1fd853f98c => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:31:17.885720 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-c82bea55-d779-4982-9e0b-5335f843f6a8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.194619 Aug 31 12:31:17.887863 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 85/184] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:17 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:31:18.894074 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-97e0cebf-bb9c-4ea6-99dc-5396d798f011 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] Calling method '.version_select at 0x7f8d17342f70>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:18.910488 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-3f0ce8ae-38b6-4dfe-a82c-a4e982d438ae tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:18.911358 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-3f0ce8ae-38b6-4dfe-a82c-a4e982d438ae tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:18.917656 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3f0ce8ae-38b6-4dfe-a82c-a4e982d438ae tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:18.918141 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3f0ce8ae-38b6-4dfe-a82c-a4e982d438ae tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:18.918568 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3f0ce8ae-38b6-4dfe-a82c-a4e982d438ae tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:18.919302 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3f0ce8ae-38b6-4dfe-a82c-a4e982d438ae tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:18.919752 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3f0ce8ae-38b6-4dfe-a82c-a4e982d438ae tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:18.920171 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3f0ce8ae-38b6-4dfe-a82c-a4e982d438ae tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:18.926953 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-97e0cebf-bb9c-4ea6-99dc-5396d798f011 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/25fe0d39-7527-41a9-8650-2b1fd853f98c" status: 200 len: 287 microversion: 2.1 time: 0.037213 Aug 31 12:31:18.927608 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 100/185] 10.222.0.79 () {58 vars in 1251 bytes} [Wed Aug 31 12:31:18 2022] GET /compute/v2.1/os-snapshots/25fe0d39-7527-41a9-8650-2b1fd853f98c => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:31:19.082217 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-3f0ce8ae-38b6-4dfe-a82c-a4e982d438ae tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:19.091404 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-3f0ce8ae-38b6-4dfe-a82c-a4e982d438ae tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.184905 Aug 31 12:31:19.092010 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 86/186] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:18 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:31:19.942794 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-28e08777-eb10-42ad-b091-ebba75b3d6cf tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] Calling method '.version_select at 0x7f8d17232550>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:19.977985 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-28e08777-eb10-42ad-b091-ebba75b3d6cf tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/25fe0d39-7527-41a9-8650-2b1fd853f98c" status: 200 len: 288 microversion: 2.1 time: 0.039513 Aug 31 12:31:19.978585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 101/187] 10.222.0.79 () {58 vars in 1251 bytes} [Wed Aug 31 12:31:19 2022] GET /compute/v2.1/os-snapshots/25fe0d39-7527-41a9-8650-2b1fd853f98c => generated 288 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:31:19.990717 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-5b01090f-8820-4428-abc1-01391287e860 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] Calling method '.version_select at 0x7f8d172c4c10>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:20.058822 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-5b01090f-8820-4428-abc1-01391287e860 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] 10.222.0.79 "DELETE /compute/v2.1/os-snapshots/25fe0d39-7527-41a9-8650-2b1fd853f98c" status: 202 len: 0 microversion: 2.1 time: 0.071404 Aug 31 12:31:20.059414 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 87/188] 10.222.0.79 () {58 vars in 1254 bytes} [Wed Aug 31 12:31:19 2022] DELETE /compute/v2.1/os-snapshots/25fe0d39-7527-41a9-8650-2b1fd853f98c => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 12:31:20.071952 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-5f9603c8-8168-46ef-8fa5-12667606f1da tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] Calling method '.version_select at 0x7f8d17330e50>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:20.114908 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-4c1786ff-14b4-4906-a2ed-7f2368ec80ce tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:20.115523 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-4c1786ff-14b4-4906-a2ed-7f2368ec80ce tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:20.123156 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4c1786ff-14b4-4906-a2ed-7f2368ec80ce tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:20.123648 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4c1786ff-14b4-4906-a2ed-7f2368ec80ce tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:20.124162 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4c1786ff-14b4-4906-a2ed-7f2368ec80ce tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:20.124786 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4c1786ff-14b4-4906-a2ed-7f2368ec80ce tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:20.125265 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4c1786ff-14b4-4906-a2ed-7f2368ec80ce tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:20.125682 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4c1786ff-14b4-4906-a2ed-7f2368ec80ce tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:20.133270 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-5f9603c8-8168-46ef-8fa5-12667606f1da tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/25fe0d39-7527-41a9-8650-2b1fd853f98c" status: 200 len: 287 microversion: 2.1 time: 0.068428 Aug 31 12:31:20.134267 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 102/189] 10.222.0.79 () {58 vars in 1251 bytes} [Wed Aug 31 12:31:20 2022] GET /compute/v2.1/os-snapshots/25fe0d39-7527-41a9-8650-2b1fd853f98c => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:31:20.294276 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-4c1786ff-14b4-4906-a2ed-7f2368ec80ce tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:20.303716 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-4c1786ff-14b4-4906-a2ed-7f2368ec80ce tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.194284 Aug 31 12:31:20.304315 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 88/190] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:20 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:31:21.152958 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-0d81c369-c536-4c81-b781-f957a0b48fc0 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] Calling method '.version_select at 0x7f8d17342dc0>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:21.193547 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-0d81c369-c536-4c81-b781-f957a0b48fc0 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/25fe0d39-7527-41a9-8650-2b1fd853f98c" status: 200 len: 287 microversion: 2.1 time: 0.046124 Aug 31 12:31:21.194286 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 103/191] 10.222.0.79 () {58 vars in 1251 bytes} [Wed Aug 31 12:31:21 2022] GET /compute/v2.1/os-snapshots/25fe0d39-7527-41a9-8650-2b1fd853f98c => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:31:21.326040 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-ae8cab57-fabf-434c-99d8-bc66db89c0ea tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:21.326792 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-ae8cab57-fabf-434c-99d8-bc66db89c0ea tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:21.336206 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ae8cab57-fabf-434c-99d8-bc66db89c0ea tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:21.338893 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ae8cab57-fabf-434c-99d8-bc66db89c0ea tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:21.339887 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ae8cab57-fabf-434c-99d8-bc66db89c0ea tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:21.341935 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ae8cab57-fabf-434c-99d8-bc66db89c0ea tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:21.343912 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ae8cab57-fabf-434c-99d8-bc66db89c0ea tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:21.344629 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ae8cab57-fabf-434c-99d8-bc66db89c0ea tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:21.634402 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-ae8cab57-fabf-434c-99d8-bc66db89c0ea tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:21.644633 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-ae8cab57-fabf-434c-99d8-bc66db89c0ea tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.323842 Aug 31 12:31:21.645286 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 89/192] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:21 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:31:22.207324 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-d979bbea-74e4-41d3-93d5-b17449f2a9f8 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] Calling method '.version_select at 0x7f8d172329d0>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:22.249387 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-d979bbea-74e4-41d3-93d5-b17449f2a9f8 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/25fe0d39-7527-41a9-8650-2b1fd853f98c" status: 200 len: 287 microversion: 2.1 time: 0.046403 Aug 31 12:31:22.250235 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 104/193] 10.222.0.79 () {58 vars in 1251 bytes} [Wed Aug 31 12:31:22 2022] GET /compute/v2.1/os-snapshots/25fe0d39-7527-41a9-8650-2b1fd853f98c => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:31:22.673639 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-bfd1df79-597e-4dd8-b9c3-c29efdff08e0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:22.674792 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-bfd1df79-597e-4dd8-b9c3-c29efdff08e0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:22.686656 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bfd1df79-597e-4dd8-b9c3-c29efdff08e0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:22.687893 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bfd1df79-597e-4dd8-b9c3-c29efdff08e0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:22.688677 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bfd1df79-597e-4dd8-b9c3-c29efdff08e0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:22.689949 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bfd1df79-597e-4dd8-b9c3-c29efdff08e0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:22.690793 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bfd1df79-597e-4dd8-b9c3-c29efdff08e0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:22.691603 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bfd1df79-597e-4dd8-b9c3-c29efdff08e0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:22.867881 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-bfd1df79-597e-4dd8-b9c3-c29efdff08e0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:22.877292 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-bfd1df79-597e-4dd8-b9c3-c29efdff08e0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.213989 Aug 31 12:31:22.877888 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 90/194] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:22 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:23.265696 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-e51f38c5-0348-493a-97c6-11231aced242 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] Calling method '.version_select at 0x7f8d173429d0>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:23.311699 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-e51f38c5-0348-493a-97c6-11231aced242 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/25fe0d39-7527-41a9-8650-2b1fd853f98c" status: 200 len: 287 microversion: 2.1 time: 0.050976 Aug 31 12:31:23.312352 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 105/195] 10.222.0.79 () {58 vars in 1251 bytes} [Wed Aug 31 12:31:23 2022] GET /compute/v2.1/os-snapshots/25fe0d39-7527-41a9-8650-2b1fd853f98c => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:31:23.900524 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-960d3a5b-b049-4035-bef1-be25cf14b7ee tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:23.902745 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-960d3a5b-b049-4035-bef1-be25cf14b7ee tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:23.904260 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:23.910485 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-960d3a5b-b049-4035-bef1-be25cf14b7ee tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:23.911079 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-960d3a5b-b049-4035-bef1-be25cf14b7ee tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:23.911465 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-960d3a5b-b049-4035-bef1-be25cf14b7ee tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:23.912208 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-960d3a5b-b049-4035-bef1-be25cf14b7ee tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:23.912741 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-960d3a5b-b049-4035-bef1-be25cf14b7ee tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:23.913172 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-960d3a5b-b049-4035-bef1-be25cf14b7ee tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:24.076986 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-960d3a5b-b049-4035-bef1-be25cf14b7ee tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:24.090501 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-960d3a5b-b049-4035-bef1-be25cf14b7ee tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.194085 Aug 31 12:31:24.091365 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 91/196] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:23 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:31:24.328891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-111b7c98-8bf5-43d8-8f74-9f257da744cf tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] Calling method '.version_select at 0x7f8d17254a60>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:24.366945 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.wsgi [None req-111b7c98-8bf5-43d8-8f74-9f257da744cf tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] HTTP exception thrown: Snapshot 25fe0d39-7527-41a9-8650-2b1fd853f98c could not be found. Aug 31 12:31:24.372659 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-111b7c98-8bf5-43d8-8f74-9f257da744cf tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] Request method failure captured: Aug 31 12:31:24.372659 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: request: GET /compute/v2.1/os-snapshots/25fe0d39-7527-41a9-8650-2b1fd853f98c HTTP/1.1 Aug 31 12:31:24.372659 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept: application/json Aug 31 12:31:24.372659 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept-Encoding: identity Aug 31 12:31:24.372659 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Connection: close Aug 31 12:31:24.372659 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Length: 0 Aug 31 12:31:24.372659 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Type: application/json Aug 31 12:31:24.372659 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Host: 10.222.0.79 Aug 31 12:31:24.372659 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Openstack-System-Scope: None Aug 31 12:31:24.372659 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: User-Agent: python-urllib3/1.26.12 Aug 31 12:31:24.372659 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Auth-Token: gAAAAABjD1SSpf2FIYqMUyEJbtEJm5jHhwb4ptElV-SNcJG9yQ3AjNPytR2tEQ7HGTatZ2yxW1bYbqqE3kSaNNzZ1ekSFBlppXTMYoYVbMHSQPY9ctG5I4n4k1TN9qulhpYIWgZH01_OvWXzA_4GJfefohOxJNv9-wmhtg4aGwpqPHCuJsGq6zA Aug 31 12:31:24.372659 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Id: None Aug 31 12:31:24.372659 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Name: None Aug 31 12:31:24.372659 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Identity-Status: Confirmed Aug 31 12:31:24.372659 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Is-Admin-Project: True Aug 31 12:31:24.372659 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Id: default Aug 31 12:31:24.372659 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Name: Default Aug 31 12:31:24.372659 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Id: de2fca6d439946e28588e2f3fedfe74f Aug 31 12:31:24.372659 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-974256248 Aug 31 12:31:24.372659 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Role: reader,member Aug 31 12:31:24.372659 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Roles: reader,member Aug 31 12:31:24.374039 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/de2fca6d439946e28588e2f3fedfe74f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_de2fca6d439946e28588e2f3fedfe74f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/de2fca6d439946e28588e2f3fedfe74f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/de2fca6d439946e28588e2f3fedfe74f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:31:24.374039 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant: tempest-VolumesSnapshotsTestJSON-974256248 Aug 31 12:31:24.374039 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Id: de2fca6d439946e28588e2f3fedfe74f Aug 31 12:31:24.374039 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-974256248 Aug 31 12:31:24.374039 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User: tempest-VolumesSnapshotsTestJSON-974256248-project Aug 31 12:31:24.374039 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Id: default Aug 31 12:31:24.374039 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Name: Default Aug 31 12:31:24.374039 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Id: 46980487b9a44c0d9849625301d2b997 Aug 31 12:31:24.374039 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Name: tempest-VolumesSnapshotsTestJSON-974256248-project Aug 31 12:31:24.374039 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: method: Aug 31 12:31:24.374039 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: exception: Snapshot 25fe0d39-7527-41a9-8650-2b1fd853f98c could not be found. Aug 31 12:31:24.374039 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: action_args: {'id': '25fe0d39-7527-41a9-8650-2b1fd853f98c'} Aug 31 12:31:24.374039 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:31:24.375007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:31:24.375007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 12:31:24.375007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 12:31:24.375007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 12:31:24.375007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 12:31:24.375007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 12:31:24.375007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 12:31:24.375007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:31:24.375007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:31:24.375007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:31:24.375007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:31:24.375007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:31:24.375007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:31:24.375007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:31:24.375007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:31:24.375007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 25fe0d39-7527-41a9-8650-2b1fd853f98c could not be found. (HTTP 404) (Request-ID: req-75a9fc33-b6ae-4fad-8502-a8f236728d05) Aug 31 12:31:24.375007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:24.375007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:31:24.376196 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:24.376196 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:31:24.376196 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 31 12:31:24.376196 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 31 12:31:24.376196 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 12:31:24.376196 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 12:31:24.376196 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 31 12:31:24.376196 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 31 12:31:24.376196 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 12:31:24.376196 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 12:31:24.376196 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 12:31:24.376196 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 12:31:24.376196 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 12:31:24.376196 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 12:31:24.376196 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 12:31:24.376196 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 12:31:24.376196 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:31:24.376196 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:31:24.376196 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:31:24.377619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:31:24.377619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:31:24.377619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:31:24.377619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:31:24.377619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:31:24.377619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 25fe0d39-7527-41a9-8650-2b1fd853f98c could not be found. Aug 31 12:31:24.377619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:24.377619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:31:24.377619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:24.377619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:31:24.377619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:31:24.377619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:31:24.377619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:31:24.377619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:31:24.377619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:31:24.377619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:31:24.377619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:31:24.377619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:31:24.377619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 31 12:31:24.377619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:31:24.379059 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 25fe0d39-7527-41a9-8650-2b1fd853f98c could not be found. Aug 31 12:31:24.379059 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:24.379059 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:31:24.379059 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:24.379059 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:31:24.379059 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:31:24.379059 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:31:24.379059 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:31:24.379059 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:31:24.379059 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 25fe0d39-7527-41a9-8650-2b1fd853f98c could not be found. Aug 31 12:31:24.379059 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:24.380326 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-111b7c98-8bf5-43d8-8f74-9f257da744cf tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] Returning 404 to user: Snapshot 25fe0d39-7527-41a9-8650-2b1fd853f98c could not be found. {{(pid=120749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:31:24.382222 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-111b7c98-8bf5-43d8-8f74-9f257da744cf tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/25fe0d39-7527-41a9-8650-2b1fd853f98c" status: 404 len: 111 microversion: 2.1 time: 0.058426 Aug 31 12:31:24.383399 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 106/197] 10.222.0.79 () {58 vars in 1251 bytes} [Wed Aug 31 12:31:24 2022] GET /compute/v2.1/os-snapshots/25fe0d39-7527-41a9-8650-2b1fd853f98c => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 12:31:24.397512 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-342942e8-9a07-4058-9277-b26c5417c143 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] Calling method '.version_select at 0x7f8d172c4dc0>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:24.500995 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-342942e8-9a07-4058-9277-b26c5417c143 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/926de173-e555-446e-8460-a1292e66945c" status: 202 len: 0 microversion: 2.1 time: 0.111554 Aug 31 12:31:24.505901 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 92/198] 10.222.0.79 () {58 vars in 1248 bytes} [Wed Aug 31 12:31:24 2022] DELETE /compute/v2.1/os-volumes/926de173-e555-446e-8460-a1292e66945c => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:31:24.514597 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-5f81d059-8f4d-4bdf-b9cc-2f5219fd4673 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] Calling method '.version_select at 0x7f8d17232c10>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:24.583488 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-5f81d059-8f4d-4bdf-b9cc-2f5219fd4673 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/926de173-e555-446e-8460-a1292e66945c" status: 200 len: 345 microversion: 2.1 time: 0.075242 Aug 31 12:31:24.584482 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 107/199] 10.222.0.79 () {58 vars in 1245 bytes} [Wed Aug 31 12:31:24 2022] GET /compute/v2.1/os-volumes/926de173-e555-446e-8460-a1292e66945c => generated 345 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:31:25.131294 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-1f5977d1-fcd6-4170-8b4f-0b4f60c84382 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:25.132813 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-1f5977d1-fcd6-4170-8b4f-0b4f60c84382 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:25.145465 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1f5977d1-fcd6-4170-8b4f-0b4f60c84382 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:25.146898 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1f5977d1-fcd6-4170-8b4f-0b4f60c84382 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:25.148114 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1f5977d1-fcd6-4170-8b4f-0b4f60c84382 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:25.150193 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1f5977d1-fcd6-4170-8b4f-0b4f60c84382 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:25.151605 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1f5977d1-fcd6-4170-8b4f-0b4f60c84382 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:25.152428 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1f5977d1-fcd6-4170-8b4f-0b4f60c84382 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:25.411684 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-1f5977d1-fcd6-4170-8b4f-0b4f60c84382 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:25.425368 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-1f5977d1-fcd6-4170-8b4f-0b4f60c84382 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.301922 Aug 31 12:31:25.426158 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 93/200] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:25 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:25.599900 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-9280539d-6141-414d-baf3-3c4ee8507c31 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] Calling method '.version_select at 0x7f8d17232820>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:25.647095 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.wsgi [None req-9280539d-6141-414d-baf3-3c4ee8507c31 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] HTTP exception thrown: Volume 926de173-e555-446e-8460-a1292e66945c could not be found. Aug 31 12:31:25.650497 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-9280539d-6141-414d-baf3-3c4ee8507c31 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] Request method failure captured: Aug 31 12:31:25.650497 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: request: GET /compute/v2.1/os-volumes/926de173-e555-446e-8460-a1292e66945c HTTP/1.1 Aug 31 12:31:25.650497 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept: application/json Aug 31 12:31:25.650497 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept-Encoding: identity Aug 31 12:31:25.650497 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Connection: close Aug 31 12:31:25.650497 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Length: 0 Aug 31 12:31:25.650497 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Type: application/json Aug 31 12:31:25.650497 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Host: 10.222.0.79 Aug 31 12:31:25.650497 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Openstack-System-Scope: None Aug 31 12:31:25.650497 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: User-Agent: python-urllib3/1.26.12 Aug 31 12:31:25.650497 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Auth-Token: gAAAAABjD1SSpf2FIYqMUyEJbtEJm5jHhwb4ptElV-SNcJG9yQ3AjNPytR2tEQ7HGTatZ2yxW1bYbqqE3kSaNNzZ1ekSFBlppXTMYoYVbMHSQPY9ctG5I4n4k1TN9qulhpYIWgZH01_OvWXzA_4GJfefohOxJNv9-wmhtg4aGwpqPHCuJsGq6zA Aug 31 12:31:25.650497 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Id: None Aug 31 12:31:25.650497 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Name: None Aug 31 12:31:25.650497 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Identity-Status: Confirmed Aug 31 12:31:25.650497 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Is-Admin-Project: True Aug 31 12:31:25.650497 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Id: default Aug 31 12:31:25.650497 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Name: Default Aug 31 12:31:25.650497 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Id: de2fca6d439946e28588e2f3fedfe74f Aug 31 12:31:25.650497 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-974256248 Aug 31 12:31:25.650497 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Role: reader,member Aug 31 12:31:25.650497 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Roles: reader,member Aug 31 12:31:25.652917 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/de2fca6d439946e28588e2f3fedfe74f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_de2fca6d439946e28588e2f3fedfe74f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/de2fca6d439946e28588e2f3fedfe74f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/de2fca6d439946e28588e2f3fedfe74f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:31:25.652917 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant: tempest-VolumesSnapshotsTestJSON-974256248 Aug 31 12:31:25.652917 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Id: de2fca6d439946e28588e2f3fedfe74f Aug 31 12:31:25.652917 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-974256248 Aug 31 12:31:25.652917 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User: tempest-VolumesSnapshotsTestJSON-974256248-project Aug 31 12:31:25.652917 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Id: default Aug 31 12:31:25.652917 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Name: Default Aug 31 12:31:25.652917 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Id: 46980487b9a44c0d9849625301d2b997 Aug 31 12:31:25.652917 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Name: tempest-VolumesSnapshotsTestJSON-974256248-project Aug 31 12:31:25.652917 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: method: Aug 31 12:31:25.652917 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: exception: Volume 926de173-e555-446e-8460-a1292e66945c could not be found. Aug 31 12:31:25.652917 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: action_args: {'id': '926de173-e555-446e-8460-a1292e66945c'} Aug 31 12:31:25.652917 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:31:25.653939 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:31:25.653939 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:31:25.653939 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:31:25.653939 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 12:31:25.653939 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 12:31:25.653939 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 12:31:25.653939 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 12:31:25.653939 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:31:25.653939 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:31:25.653939 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:31:25.653939 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:31:25.653939 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:31:25.653939 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:31:25.653939 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:31:25.653939 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:31:25.653939 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 926de173-e555-446e-8460-a1292e66945c could not be found. (HTTP 404) (Request-ID: req-3cbdbc03-40b3-413e-9452-0c6cee99ca1b) Aug 31 12:31:25.653939 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:25.653939 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:31:25.653939 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:25.655172 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:31:25.655172 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 12:31:25.655172 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 12:31:25.655172 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 12:31:25.655172 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 12:31:25.655172 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 12:31:25.655172 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 12:31:25.655172 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 12:31:25.655172 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 12:31:25.655172 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:31:25.655172 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:31:25.655172 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 12:31:25.655172 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 12:31:25.655172 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 12:31:25.655172 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 12:31:25.655172 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:31:25.655172 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:31:25.655172 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:31:25.655172 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:31:25.656304 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:31:25.656304 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:31:25.656304 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:31:25.656304 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:31:25.656304 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 926de173-e555-446e-8460-a1292e66945c could not be found. Aug 31 12:31:25.656304 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:25.656304 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:31:25.656304 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:25.656304 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:31:25.656304 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:31:25.656304 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:31:25.656304 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:31:25.656304 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:31:25.656304 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:31:25.656304 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:31:25.656304 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:31:25.656304 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:31:25.656304 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 12:31:25.656304 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:31:25.658167 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 926de173-e555-446e-8460-a1292e66945c could not be found. Aug 31 12:31:25.658167 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:25.658167 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:31:25.658167 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:25.658167 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:31:25.658167 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:31:25.658167 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:31:25.658167 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:31:25.658167 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:31:25.658167 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 926de173-e555-446e-8460-a1292e66945c could not be found. Aug 31 12:31:25.658167 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:25.658167 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-9280539d-6141-414d-baf3-3c4ee8507c31 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] Returning 404 to user: Volume 926de173-e555-446e-8460-a1292e66945c could not be found. {{(pid=120749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:31:25.658167 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-9280539d-6141-414d-baf3-3c4ee8507c31 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/926de173-e555-446e-8460-a1292e66945c" status: 404 len: 109 microversion: 2.1 time: 0.059443 Aug 31 12:31:25.665386 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 108/201] 10.222.0.79 () {58 vars in 1245 bytes} [Wed Aug 31 12:31:25 2022] GET /compute/v2.1/os-volumes/926de173-e555-446e-8460-a1292e66945c => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:31:25.669684 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-daac2e56-851a-4ffd-b3fe-bf976b1fe844 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] Calling method '.version_select at 0x7f8d174c3550>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:25.728800 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-daac2e56-851a-4ffd-b3fe-bf976b1fe844 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] HTTP exception thrown: Volume 926de173-e555-446e-8460-a1292e66945c could not be found. Aug 31 12:31:25.736073 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-daac2e56-851a-4ffd-b3fe-bf976b1fe844 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] Request method failure captured: Aug 31 12:31:25.736073 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: DELETE /compute/v2.1/os-volumes/926de173-e555-446e-8460-a1292e66945c HTTP/1.1 Aug 31 12:31:25.736073 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:31:25.736073 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:31:25.736073 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:31:25.736073 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 0 Aug 31 12:31:25.736073 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:31:25.736073 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:31:25.736073 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:31:25.736073 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:31:25.736073 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1SSpf2FIYqMUyEJbtEJm5jHhwb4ptElV-SNcJG9yQ3AjNPytR2tEQ7HGTatZ2yxW1bYbqqE3kSaNNzZ1ekSFBlppXTMYoYVbMHSQPY9ctG5I4n4k1TN9qulhpYIWgZH01_OvWXzA_4GJfefohOxJNv9-wmhtg4aGwpqPHCuJsGq6zA Aug 31 12:31:25.736073 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:31:25.736073 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:31:25.736073 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:31:25.736073 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:31:25.736073 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:31:25.736073 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:31:25.736073 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: de2fca6d439946e28588e2f3fedfe74f Aug 31 12:31:25.736073 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-974256248 Aug 31 12:31:25.736073 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:31:25.736073 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:31:25.738800 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/de2fca6d439946e28588e2f3fedfe74f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_de2fca6d439946e28588e2f3fedfe74f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/de2fca6d439946e28588e2f3fedfe74f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/de2fca6d439946e28588e2f3fedfe74f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:31:25.738800 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-VolumesSnapshotsTestJSON-974256248 Aug 31 12:31:25.738800 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: de2fca6d439946e28588e2f3fedfe74f Aug 31 12:31:25.738800 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-974256248 Aug 31 12:31:25.738800 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-VolumesSnapshotsTestJSON-974256248-project Aug 31 12:31:25.738800 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:31:25.738800 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:31:25.738800 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: 46980487b9a44c0d9849625301d2b997 Aug 31 12:31:25.738800 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-VolumesSnapshotsTestJSON-974256248-project Aug 31 12:31:25.738800 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: Aug 31 12:31:25.738800 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Volume 926de173-e555-446e-8460-a1292e66945c could not be found. Aug 31 12:31:25.738800 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'id': '926de173-e555-446e-8460-a1292e66945c'} Aug 31 12:31:25.738800 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:31:25.741088 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:31:25.741088 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:31:25.741088 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:31:25.741088 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 12:31:25.741088 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 12:31:25.741088 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 12:31:25.741088 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 12:31:25.741088 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 12:31:25.741088 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 12:31:25.741088 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 12:31:25.741088 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 12:31:25.741088 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:31:25.741088 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:31:25.741088 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:31:25.741088 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:31:25.741088 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 926de173-e555-446e-8460-a1292e66945c could not be found. (HTTP 404) (Request-ID: req-e10de3ce-a319-4d6e-b1e9-57faa9bf9fab) Aug 31 12:31:25.741088 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:31:25.741088 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:31:25.741088 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:31:25.743573 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:31:25.743573 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 12:31:25.743573 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 12:31:25.743573 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 12:31:25.743573 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 12:31:25.743573 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 12:31:25.743573 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 12:31:25.743573 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 12:31:25.743573 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 12:31:25.743573 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:31:25.743573 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:31:25.743573 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 12:31:25.743573 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 12:31:25.743573 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 12:31:25.743573 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 12:31:25.743573 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 12:31:25.743573 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 12:31:25.743573 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 12:31:25.743573 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 12:31:25.746741 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:31:25.746741 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:31:25.746741 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:31:25.746741 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:31:25.746741 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 926de173-e555-446e-8460-a1292e66945c could not be found. Aug 31 12:31:25.746741 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:31:25.746741 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:31:25.746741 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:31:25.746741 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:31:25.746741 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:31:25.746741 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:31:25.746741 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:31:25.746741 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:31:25.746741 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:31:25.746741 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:31:25.746741 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:31:25.746741 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:31:25.746741 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 12:31:25.746741 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:31:25.749050 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 926de173-e555-446e-8460-a1292e66945c could not be found. Aug 31 12:31:25.749050 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:31:25.749050 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:31:25.749050 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:31:25.749050 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:31:25.749050 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:31:25.749050 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:31:25.749050 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:31:25.749050 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:31:25.749050 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 926de173-e555-446e-8460-a1292e66945c could not be found. Aug 31 12:31:25.749050 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:31:25.749050 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-daac2e56-851a-4ffd-b3fe-bf976b1fe844 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] Returning 404 to user: Volume 926de173-e555-446e-8460-a1292e66945c could not be found. {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:31:25.762050 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-daac2e56-851a-4ffd-b3fe-bf976b1fe844 tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/926de173-e555-446e-8460-a1292e66945c" status: 404 len: 109 microversion: 2.1 time: 0.095720 Aug 31 12:31:25.765758 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 94/202] 10.222.0.79 () {58 vars in 1248 bytes} [Wed Aug 31 12:31:25 2022] DELETE /compute/v2.1/os-volumes/926de173-e555-446e-8460-a1292e66945c => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 12:31:25.773740 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-fb1cb086-a920-429f-abbf-1db99219eb2f tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] Calling method '.version_select at 0x7f8d172321f0>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:25.823070 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.wsgi [None req-fb1cb086-a920-429f-abbf-1db99219eb2f tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] HTTP exception thrown: Volume 926de173-e555-446e-8460-a1292e66945c could not be found. Aug 31 12:31:25.825772 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-fb1cb086-a920-429f-abbf-1db99219eb2f tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] Request method failure captured: Aug 31 12:31:25.825772 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: request: GET /compute/v2.1/os-volumes/926de173-e555-446e-8460-a1292e66945c HTTP/1.1 Aug 31 12:31:25.825772 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept: application/json Aug 31 12:31:25.825772 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept-Encoding: identity Aug 31 12:31:25.825772 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Connection: close Aug 31 12:31:25.825772 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Length: 0 Aug 31 12:31:25.825772 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Type: application/json Aug 31 12:31:25.825772 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Host: 10.222.0.79 Aug 31 12:31:25.825772 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Openstack-System-Scope: None Aug 31 12:31:25.825772 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: User-Agent: python-urllib3/1.26.12 Aug 31 12:31:25.825772 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Auth-Token: gAAAAABjD1SSpf2FIYqMUyEJbtEJm5jHhwb4ptElV-SNcJG9yQ3AjNPytR2tEQ7HGTatZ2yxW1bYbqqE3kSaNNzZ1ekSFBlppXTMYoYVbMHSQPY9ctG5I4n4k1TN9qulhpYIWgZH01_OvWXzA_4GJfefohOxJNv9-wmhtg4aGwpqPHCuJsGq6zA Aug 31 12:31:25.825772 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Id: None Aug 31 12:31:25.825772 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Name: None Aug 31 12:31:25.825772 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Identity-Status: Confirmed Aug 31 12:31:25.825772 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Is-Admin-Project: True Aug 31 12:31:25.825772 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Id: default Aug 31 12:31:25.825772 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Name: Default Aug 31 12:31:25.825772 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Id: de2fca6d439946e28588e2f3fedfe74f Aug 31 12:31:25.825772 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-974256248 Aug 31 12:31:25.825772 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Role: reader,member Aug 31 12:31:25.825772 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Roles: reader,member Aug 31 12:31:25.827093 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/de2fca6d439946e28588e2f3fedfe74f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_de2fca6d439946e28588e2f3fedfe74f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/de2fca6d439946e28588e2f3fedfe74f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/de2fca6d439946e28588e2f3fedfe74f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:31:25.827093 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant: tempest-VolumesSnapshotsTestJSON-974256248 Aug 31 12:31:25.827093 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Id: de2fca6d439946e28588e2f3fedfe74f Aug 31 12:31:25.827093 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-974256248 Aug 31 12:31:25.827093 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User: tempest-VolumesSnapshotsTestJSON-974256248-project Aug 31 12:31:25.827093 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Id: default Aug 31 12:31:25.827093 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Name: Default Aug 31 12:31:25.827093 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Id: 46980487b9a44c0d9849625301d2b997 Aug 31 12:31:25.827093 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Name: tempest-VolumesSnapshotsTestJSON-974256248-project Aug 31 12:31:25.827093 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: method: Aug 31 12:31:25.827093 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: exception: Volume 926de173-e555-446e-8460-a1292e66945c could not be found. Aug 31 12:31:25.827093 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: action_args: {'id': '926de173-e555-446e-8460-a1292e66945c'} Aug 31 12:31:25.827093 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:31:25.827928 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:31:25.827928 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:31:25.827928 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:31:25.827928 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 12:31:25.827928 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 12:31:25.827928 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 12:31:25.827928 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 12:31:25.827928 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:31:25.827928 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:31:25.827928 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:31:25.827928 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:31:25.827928 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:31:25.827928 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:31:25.827928 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:31:25.827928 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:31:25.827928 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 926de173-e555-446e-8460-a1292e66945c could not be found. (HTTP 404) (Request-ID: req-43e09d6f-0e3e-49bc-b091-f6ccedc46341) Aug 31 12:31:25.827928 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:25.827928 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:31:25.827928 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:25.829014 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:31:25.829014 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 12:31:25.829014 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 12:31:25.829014 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 12:31:25.829014 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 12:31:25.829014 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 12:31:25.829014 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 12:31:25.829014 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 12:31:25.829014 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 12:31:25.829014 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:31:25.829014 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:31:25.829014 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 12:31:25.829014 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 12:31:25.829014 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 12:31:25.829014 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 12:31:25.829014 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:31:25.829014 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:31:25.829014 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:31:25.829014 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:31:25.830198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:31:25.830198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:31:25.830198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:31:25.830198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:31:25.830198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 926de173-e555-446e-8460-a1292e66945c could not be found. Aug 31 12:31:25.830198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:25.830198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:31:25.830198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:25.830198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:31:25.830198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:31:25.830198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:31:25.830198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:31:25.830198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:31:25.830198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:31:25.830198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:31:25.830198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:31:25.830198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:31:25.830198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 12:31:25.830198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:31:25.831478 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 926de173-e555-446e-8460-a1292e66945c could not be found. Aug 31 12:31:25.831478 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:25.831478 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:31:25.831478 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:25.831478 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:31:25.831478 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:31:25.831478 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:31:25.831478 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:31:25.831478 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:31:25.831478 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 926de173-e555-446e-8460-a1292e66945c could not be found. Aug 31 12:31:25.831478 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:31:25.833015 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-fb1cb086-a920-429f-abbf-1db99219eb2f tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] Returning 404 to user: Volume 926de173-e555-446e-8460-a1292e66945c could not be found. {{(pid=120749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:31:25.834108 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-fb1cb086-a920-429f-abbf-1db99219eb2f tempest-VolumesSnapshotsTestJSON-974256248 tempest-VolumesSnapshotsTestJSON-974256248-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/926de173-e555-446e-8460-a1292e66945c" status: 404 len: 109 microversion: 2.1 time: 0.064953 Aug 31 12:31:25.834678 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 109/203] 10.222.0.79 () {58 vars in 1245 bytes} [Wed Aug 31 12:31:25 2022] GET /compute/v2.1/os-volumes/926de173-e555-446e-8460-a1292e66945c => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 12:31:26.450602 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-17cb85fd-f5b3-4d3b-8989-a3caf2f3e7fa tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:26.451496 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-17cb85fd-f5b3-4d3b-8989-a3caf2f3e7fa tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:26.463763 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-17cb85fd-f5b3-4d3b-8989-a3caf2f3e7fa tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:26.466002 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-17cb85fd-f5b3-4d3b-8989-a3caf2f3e7fa tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:26.467436 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-17cb85fd-f5b3-4d3b-8989-a3caf2f3e7fa tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:26.469138 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-17cb85fd-f5b3-4d3b-8989-a3caf2f3e7fa tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:26.470356 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-17cb85fd-f5b3-4d3b-8989-a3caf2f3e7fa tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:26.471401 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-17cb85fd-f5b3-4d3b-8989-a3caf2f3e7fa tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:26.692874 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-17cb85fd-f5b3-4d3b-8989-a3caf2f3e7fa tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:26.701817 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-17cb85fd-f5b3-4d3b-8989-a3caf2f3e7fa tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.256864 Aug 31 12:31:26.702661 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 95/204] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:26 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:27.739822 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_api:SELECT=3 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:27.743012 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=60 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:27.748292 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-31858924-e34a-4755-ad2f-a7309d4a6821 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:27.748905 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-31858924-e34a-4755-ad2f-a7309d4a6821 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:27.759606 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-31858924-e34a-4755-ad2f-a7309d4a6821 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:27.759772 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-31858924-e34a-4755-ad2f-a7309d4a6821 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:27.761411 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-31858924-e34a-4755-ad2f-a7309d4a6821 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:27.763263 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-31858924-e34a-4755-ad2f-a7309d4a6821 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:27.764730 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-31858924-e34a-4755-ad2f-a7309d4a6821 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:27.765833 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-31858924-e34a-4755-ad2f-a7309d4a6821 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:27.950636 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-31858924-e34a-4755-ad2f-a7309d4a6821 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:27.959162 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-31858924-e34a-4755-ad2f-a7309d4a6821 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.220675 Aug 31 12:31:27.959917 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 110/205] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:27 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:31:28.990754 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-623061d2-627d-49a7-ab6f-451236f35026 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:28.991765 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-623061d2-627d-49a7-ab6f-451236f35026 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:29.004697 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-623061d2-627d-49a7-ab6f-451236f35026 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:29.005406 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-623061d2-627d-49a7-ab6f-451236f35026 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:29.006415 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-623061d2-627d-49a7-ab6f-451236f35026 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:29.010671 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-623061d2-627d-49a7-ab6f-451236f35026 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:29.012373 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-623061d2-627d-49a7-ab6f-451236f35026 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:29.015059 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-623061d2-627d-49a7-ab6f-451236f35026 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:29.400466 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-623061d2-627d-49a7-ab6f-451236f35026 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:29.416811 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-623061d2-627d-49a7-ab6f-451236f35026 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.435848 Aug 31 12:31:29.418242 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 96/206] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:28 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:30.461865 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-97fc5d3b-0193-438c-89e9-f1c933ddfd03 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:30.462775 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-97fc5d3b-0193-438c-89e9-f1c933ddfd03 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:30.476617 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-97fc5d3b-0193-438c-89e9-f1c933ddfd03 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:30.477556 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-97fc5d3b-0193-438c-89e9-f1c933ddfd03 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:30.478902 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-97fc5d3b-0193-438c-89e9-f1c933ddfd03 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:30.480424 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-97fc5d3b-0193-438c-89e9-f1c933ddfd03 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:30.481707 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-97fc5d3b-0193-438c-89e9-f1c933ddfd03 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:30.482440 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-97fc5d3b-0193-438c-89e9-f1c933ddfd03 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:30.762757 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-97fc5d3b-0193-438c-89e9-f1c933ddfd03 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:30.785627 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-97fc5d3b-0193-438c-89e9-f1c933ddfd03 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1521 microversion: 2.1 time: 0.331593 Aug 31 12:31:30.787446 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 111/207] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:30 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:31.831973 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-cccb6625-d981-455d-a3fa-41ad038d1b2e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:31.837422 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-cccb6625-d981-455d-a3fa-41ad038d1b2e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:31.852956 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cccb6625-d981-455d-a3fa-41ad038d1b2e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:31.854720 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cccb6625-d981-455d-a3fa-41ad038d1b2e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:31.859737 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cccb6625-d981-455d-a3fa-41ad038d1b2e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:31.863132 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cccb6625-d981-455d-a3fa-41ad038d1b2e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:31.865155 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cccb6625-d981-455d-a3fa-41ad038d1b2e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:31.869885 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cccb6625-d981-455d-a3fa-41ad038d1b2e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:32.366662 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-cccb6625-d981-455d-a3fa-41ad038d1b2e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:32.395190 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-cccb6625-d981-455d-a3fa-41ad038d1b2e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1501 microversion: 2.1 time: 0.568052 Aug 31 12:31:32.396756 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 97/208] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:31 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1501 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:32.425692 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-d421278b-581c-4e8b-9a00-a12334f51a45 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:32.427517 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-d421278b-581c-4e8b-9a00-a12334f51a45 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:32.453185 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d421278b-581c-4e8b-9a00-a12334f51a45 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:32.454938 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d421278b-581c-4e8b-9a00-a12334f51a45 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:32.455957 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d421278b-581c-4e8b-9a00-a12334f51a45 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:32.457542 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d421278b-581c-4e8b-9a00-a12334f51a45 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:32.458237 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d421278b-581c-4e8b-9a00-a12334f51a45 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:32.459144 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d421278b-581c-4e8b-9a00-a12334f51a45 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:32.813117 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-d421278b-581c-4e8b-9a00-a12334f51a45 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:32.835171 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-d421278b-581c-4e8b-9a00-a12334f51a45 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1515 microversion: 2.1 time: 0.418073 Aug 31 12:31:32.837000 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 112/209] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:32 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1515 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:34.506410 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-4b7e9a1f-7edc-4d35-b75f-aa94a87afd68 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:31:34.510050 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-4b7e9a1f-7edc-4d35-b75f-aa94a87afd68 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:34.517447 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4b7e9a1f-7edc-4d35-b75f-aa94a87afd68 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:34.518042 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4b7e9a1f-7edc-4d35-b75f-aa94a87afd68 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:34.518561 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4b7e9a1f-7edc-4d35-b75f-aa94a87afd68 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:34.519545 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4b7e9a1f-7edc-4d35-b75f-aa94a87afd68 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:34.520380 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4b7e9a1f-7edc-4d35-b75f-aa94a87afd68 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:34.521077 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4b7e9a1f-7edc-4d35-b75f-aa94a87afd68 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:34.558349 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.objects.instance [None req-4b7e9a1f-7edc-4d35-b75f-aa94a87afd68 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lazy-loading 'flavor' on Instance uuid bbae24ec-b404-415c-97a7-a78cd28ff068 {{(pid=120750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:31:34.768971 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-4b7e9a1f-7edc-4d35-b75f-aa94a87afd68 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "POST /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068/action" status: 200 len: 32 microversion: 2.1 time: 0.267946 Aug 31 12:31:34.770288 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 98/210] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Aug 31 12:31:34 2022] POST /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068/action => generated 32 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 12:31:34.790111 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-2942f75d-5a31-412c-83b2-732a501b1cb3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:34.793357 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-2942f75d-5a31-412c-83b2-732a501b1cb3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:34.812224 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2942f75d-5a31-412c-83b2-732a501b1cb3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:34.813425 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2942f75d-5a31-412c-83b2-732a501b1cb3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:34.814455 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2942f75d-5a31-412c-83b2-732a501b1cb3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:34.816914 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2942f75d-5a31-412c-83b2-732a501b1cb3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:34.818688 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2942f75d-5a31-412c-83b2-732a501b1cb3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:34.819553 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2942f75d-5a31-412c-83b2-732a501b1cb3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:35.089848 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-2942f75d-5a31-412c-83b2-732a501b1cb3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:35.105374 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-2942f75d-5a31-412c-83b2-732a501b1cb3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1521 microversion: 2.1 time: 0.326278 Aug 31 12:31:35.107370 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 113/211] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:34 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:36.146143 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-8ec37127-7408-456e-8824-d1d260ebfc7b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:36.148599 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-8ec37127-7408-456e-8824-d1d260ebfc7b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:36.182118 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8ec37127-7408-456e-8824-d1d260ebfc7b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:36.183504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8ec37127-7408-456e-8824-d1d260ebfc7b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:36.184231 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8ec37127-7408-456e-8824-d1d260ebfc7b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:36.187214 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8ec37127-7408-456e-8824-d1d260ebfc7b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:36.188155 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8ec37127-7408-456e-8824-d1d260ebfc7b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:36.188850 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8ec37127-7408-456e-8824-d1d260ebfc7b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:36.385223 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-8ec37127-7408-456e-8824-d1d260ebfc7b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:36.396990 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-8ec37127-7408-456e-8824-d1d260ebfc7b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1521 microversion: 2.1 time: 0.257477 Aug 31 12:31:36.398436 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 99/212] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:36 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:37.426508 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-4a432307-8031-412d-a005-780f0b916e57 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:37.427531 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-4a432307-8031-412d-a005-780f0b916e57 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:37.436024 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4a432307-8031-412d-a005-780f0b916e57 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:37.436698 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4a432307-8031-412d-a005-780f0b916e57 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:37.437365 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4a432307-8031-412d-a005-780f0b916e57 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:37.438455 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4a432307-8031-412d-a005-780f0b916e57 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:37.439094 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4a432307-8031-412d-a005-780f0b916e57 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:37.439677 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4a432307-8031-412d-a005-780f0b916e57 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:37.684684 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-4a432307-8031-412d-a005-780f0b916e57 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:37.693867 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-4a432307-8031-412d-a005-780f0b916e57 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1521 microversion: 2.1 time: 0.271824 Aug 31 12:31:37.694616 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 114/213] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:37 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:38.716529 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-d640b248-d935-4fe2-8aef-e73651783fa7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:38.717306 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-d640b248-d935-4fe2-8aef-e73651783fa7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:38.729764 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d640b248-d935-4fe2-8aef-e73651783fa7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:38.731771 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d640b248-d935-4fe2-8aef-e73651783fa7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:38.733674 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d640b248-d935-4fe2-8aef-e73651783fa7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:38.735563 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d640b248-d935-4fe2-8aef-e73651783fa7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:38.736495 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d640b248-d935-4fe2-8aef-e73651783fa7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:38.738611 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d640b248-d935-4fe2-8aef-e73651783fa7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:39.065660 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-d640b248-d935-4fe2-8aef-e73651783fa7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:39.083841 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-d640b248-d935-4fe2-8aef-e73651783fa7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1521 microversion: 2.1 time: 0.369990 Aug 31 12:31:39.085656 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 100/214] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:38 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:40.110540 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-1a257ab8-a555-46eb-9fe7-650d7f76888d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:40.118834 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-1a257ab8-a555-46eb-9fe7-650d7f76888d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:40.129146 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1a257ab8-a555-46eb-9fe7-650d7f76888d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:40.130573 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1a257ab8-a555-46eb-9fe7-650d7f76888d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:40.132803 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1a257ab8-a555-46eb-9fe7-650d7f76888d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:40.135216 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1a257ab8-a555-46eb-9fe7-650d7f76888d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:40.136619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1a257ab8-a555-46eb-9fe7-650d7f76888d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:40.137434 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1a257ab8-a555-46eb-9fe7-650d7f76888d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:40.414392 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-1a257ab8-a555-46eb-9fe7-650d7f76888d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:40.432559 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-1a257ab8-a555-46eb-9fe7-650d7f76888d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1521 microversion: 2.1 time: 0.329397 Aug 31 12:31:40.435697 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 115/215] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:40 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:41.182027 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-99332691-f542-4270-8550-7faa0849bc0c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:41.183573 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-99332691-f542-4270-8550-7faa0849bc0c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:41.197406 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-99332691-f542-4270-8550-7faa0849bc0c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:41.199113 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-99332691-f542-4270-8550-7faa0849bc0c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:41.201969 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-99332691-f542-4270-8550-7faa0849bc0c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:41.203385 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-99332691-f542-4270-8550-7faa0849bc0c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:41.204462 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-99332691-f542-4270-8550-7faa0849bc0c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:41.205545 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-99332691-f542-4270-8550-7faa0849bc0c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:41.257280 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-99332691-f542-4270-8550-7faa0849bc0c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8/ips" status: 200 len: 151 microversion: 2.20 time: 0.079441 Aug 31 12:31:41.259472 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 101/216] 10.222.0.79 () {60 vars in 1289 bytes} [Wed Aug 31 12:31:41 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8/ips => generated 151 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:31:41.469399 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-0a64acae-f2d9-4335-831d-cfbdd03230f5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:41.470977 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-0a64acae-f2d9-4335-831d-cfbdd03230f5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:41.519110 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0a64acae-f2d9-4335-831d-cfbdd03230f5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:41.520620 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0a64acae-f2d9-4335-831d-cfbdd03230f5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:41.521609 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0a64acae-f2d9-4335-831d-cfbdd03230f5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:41.527069 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0a64acae-f2d9-4335-831d-cfbdd03230f5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:41.531182 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0a64acae-f2d9-4335-831d-cfbdd03230f5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:41.531985 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0a64acae-f2d9-4335-831d-cfbdd03230f5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:41.790879 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-0a64acae-f2d9-4335-831d-cfbdd03230f5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:41.801466 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-0a64acae-f2d9-4335-831d-cfbdd03230f5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1521 microversion: 2.1 time: 0.347547 Aug 31 12:31:41.802560 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 116/217] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:41 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:31:42.827331 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-4386b4bc-e5e6-42a5-8c6b-f8db61f8b556 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:42.828370 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-4386b4bc-e5e6-42a5-8c6b-f8db61f8b556 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:42.838099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4386b4bc-e5e6-42a5-8c6b-f8db61f8b556 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:42.838763 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4386b4bc-e5e6-42a5-8c6b-f8db61f8b556 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:42.839822 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4386b4bc-e5e6-42a5-8c6b-f8db61f8b556 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:42.840728 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4386b4bc-e5e6-42a5-8c6b-f8db61f8b556 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:42.841176 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4386b4bc-e5e6-42a5-8c6b-f8db61f8b556 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:42.841743 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4386b4bc-e5e6-42a5-8c6b-f8db61f8b556 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:42.847298 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:43.136998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-4386b4bc-e5e6-42a5-8c6b-f8db61f8b556 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:43.150483 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-4386b4bc-e5e6-42a5-8c6b-f8db61f8b556 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1521 microversion: 2.1 time: 0.328569 Aug 31 12:31:43.156444 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 102/218] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:42 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:43.836715 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-fac147fe-89bd-48b1-9411-b03c052b3cde tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:43.837882 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-fac147fe-89bd-48b1-9411-b03c052b3cde tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:43.851593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fac147fe-89bd-48b1-9411-b03c052b3cde tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:43.853251 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fac147fe-89bd-48b1-9411-b03c052b3cde tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:43.854601 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fac147fe-89bd-48b1-9411-b03c052b3cde tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:43.857592 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fac147fe-89bd-48b1-9411-b03c052b3cde tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:43.858747 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fac147fe-89bd-48b1-9411-b03c052b3cde tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:43.859563 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fac147fe-89bd-48b1-9411-b03c052b3cde tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:43.909453 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-fac147fe-89bd-48b1-9411-b03c052b3cde tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285/ips" status: 200 len: 145 microversion: 2.1 time: 0.081327 Aug 31 12:31:43.910640 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 117/219] 10.222.0.79 () {58 vars in 1248 bytes} [Wed Aug 31 12:31:43 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285/ips => generated 145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:31:44.182403 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-e3cc538d-9eb2-46b3-b607-19ac900677ac tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:44.183810 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-e3cc538d-9eb2-46b3-b607-19ac900677ac tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:44.203996 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e3cc538d-9eb2-46b3-b607-19ac900677ac tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:44.210075 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e3cc538d-9eb2-46b3-b607-19ac900677ac tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:44.211110 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e3cc538d-9eb2-46b3-b607-19ac900677ac tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:44.212413 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e3cc538d-9eb2-46b3-b607-19ac900677ac tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:44.216692 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e3cc538d-9eb2-46b3-b607-19ac900677ac tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:44.217895 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e3cc538d-9eb2-46b3-b607-19ac900677ac tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:44.348568 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-b99541cc-43a6-49dd-ba25-491bfc6ff0eb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:31:44.355980 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-b99541cc-43a6-49dd-ba25-491bfc6ff0eb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:44.363752 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b99541cc-43a6-49dd-ba25-491bfc6ff0eb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:44.364531 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b99541cc-43a6-49dd-ba25-491bfc6ff0eb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:44.365152 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b99541cc-43a6-49dd-ba25-491bfc6ff0eb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:44.366147 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b99541cc-43a6-49dd-ba25-491bfc6ff0eb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:44.367022 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b99541cc-43a6-49dd-ba25-491bfc6ff0eb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:44.367732 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b99541cc-43a6-49dd-ba25-491bfc6ff0eb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:44.425123 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-e3cc538d-9eb2-46b3-b607-19ac900677ac tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:44.431098 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.objects.instance [None req-b99541cc-43a6-49dd-ba25-491bfc6ff0eb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lazy-loading 'flavor' on Instance uuid 34ecec01-dd25-474d-addd-1d9b8de152b8 {{(pid=120749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:31:44.440131 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-e3cc538d-9eb2-46b3-b607-19ac900677ac tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1521 microversion: 2.1 time: 0.265153 Aug 31 12:31:44.441328 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 103/220] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:44 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:44.791243 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-b99541cc-43a6-49dd-ba25-491bfc6ff0eb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "POST /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8/action" status: 202 len: 0 microversion: 2.20 time: 0.447959 Aug 31 12:31:44.792119 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 118/221] 10.222.0.79 () {62 vars in 1319 bytes} [Wed Aug 31 12:31:44 2022] POST /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:31:44.804249 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-73513204-bfa7-42aa-a4de-adab2940d6fb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:44.805255 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-73513204-bfa7-42aa-a4de-adab2940d6fb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:44.814652 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-73513204-bfa7-42aa-a4de-adab2940d6fb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:44.815443 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-73513204-bfa7-42aa-a4de-adab2940d6fb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:44.816071 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-73513204-bfa7-42aa-a4de-adab2940d6fb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:44.819071 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-73513204-bfa7-42aa-a4de-adab2940d6fb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:44.820216 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-73513204-bfa7-42aa-a4de-adab2940d6fb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:44.821015 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-73513204-bfa7-42aa-a4de-adab2940d6fb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:45.205449 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-73513204-bfa7-42aa-a4de-adab2940d6fb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:45.239557 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-73513204-bfa7-42aa-a4de-adab2940d6fb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:45.242007 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-73513204-bfa7-42aa-a4de-adab2940d6fb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:45.243379 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-73513204-bfa7-42aa-a4de-adab2940d6fb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1724 microversion: 2.20 time: 0.444497 Aug 31 12:31:45.251297 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 104/222] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:31:44 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1724 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:31:45.467581 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-c6a6b894-f37a-47d5-8e6d-75936897994b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:45.468513 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-c6a6b894-f37a-47d5-8e6d-75936897994b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:45.489718 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c6a6b894-f37a-47d5-8e6d-75936897994b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:45.490660 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c6a6b894-f37a-47d5-8e6d-75936897994b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:45.492478 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c6a6b894-f37a-47d5-8e6d-75936897994b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:45.494348 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c6a6b894-f37a-47d5-8e6d-75936897994b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:45.498236 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c6a6b894-f37a-47d5-8e6d-75936897994b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:45.499312 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c6a6b894-f37a-47d5-8e6d-75936897994b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:45.701427 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-c6a6b894-f37a-47d5-8e6d-75936897994b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:45.711142 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-c6a6b894-f37a-47d5-8e6d-75936897994b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1521 microversion: 2.1 time: 0.251084 Aug 31 12:31:45.711828 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 119/223] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:45 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:46.293980 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-50e5d2a2-596c-4ccc-81c5-64278edffd04 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:46.294688 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-50e5d2a2-596c-4ccc-81c5-64278edffd04 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:46.301323 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-50e5d2a2-596c-4ccc-81c5-64278edffd04 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:46.302095 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-50e5d2a2-596c-4ccc-81c5-64278edffd04 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:46.302741 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-50e5d2a2-596c-4ccc-81c5-64278edffd04 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:46.303986 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-50e5d2a2-596c-4ccc-81c5-64278edffd04 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:46.304720 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-50e5d2a2-596c-4ccc-81c5-64278edffd04 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:46.305330 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-50e5d2a2-596c-4ccc-81c5-64278edffd04 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:46.613063 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-50e5d2a2-596c-4ccc-81c5-64278edffd04 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:46.651127 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-50e5d2a2-596c-4ccc-81c5-64278edffd04 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:46.658446 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-4e75bccc-f365-42e4-babd-01ed246cfc0a tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "150c5871-234d-4c4f-8dac-23a8a07bfc4e"}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:31:46.661519 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-4e75bccc-f365-42e4-babd-01ed246cfc0a tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:46.664956 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-50e5d2a2-596c-4ccc-81c5-64278edffd04 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:46.670720 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-50e5d2a2-596c-4ccc-81c5-64278edffd04 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1724 microversion: 2.20 time: 0.385146 Aug 31 12:31:46.673212 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 105/224] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:31:46 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1724 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:31:46.692909 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4e75bccc-f365-42e4-babd-01ed246cfc0a tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:46.693803 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4e75bccc-f365-42e4-babd-01ed246cfc0a tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:46.694636 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4e75bccc-f365-42e4-babd-01ed246cfc0a tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:46.695890 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4e75bccc-f365-42e4-babd-01ed246cfc0a tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:46.698934 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4e75bccc-f365-42e4-babd-01ed246cfc0a tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:46.700712 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4e75bccc-f365-42e4-babd-01ed246cfc0a tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:46.735777 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-8dbd1004-412f-4f85-b76f-1a1ef8709f59 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:46.736711 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-8dbd1004-412f-4f85-b76f-1a1ef8709f59 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:46.749516 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8dbd1004-412f-4f85-b76f-1a1ef8709f59 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:46.750420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8dbd1004-412f-4f85-b76f-1a1ef8709f59 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:46.752590 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8dbd1004-412f-4f85-b76f-1a1ef8709f59 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:46.754384 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8dbd1004-412f-4f85-b76f-1a1ef8709f59 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:46.755628 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8dbd1004-412f-4f85-b76f-1a1ef8709f59 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:46.757986 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8dbd1004-412f-4f85-b76f-1a1ef8709f59 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:47.009795 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-8dbd1004-412f-4f85-b76f-1a1ef8709f59 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:47.021927 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-8dbd1004-412f-4f85-b76f-1a1ef8709f59 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1521 microversion: 2.1 time: 0.292121 Aug 31 12:31:47.025509 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 106/225] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:46 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:31:47.176262 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-4e75bccc-f365-42e4-babd-01ed246cfc0a tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "POST /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.526318 Aug 31 12:31:47.177790 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 120/226] 10.222.0.79 () {60 vars in 1323 bytes} [Wed Aug 31 12:31:46 2022] POST /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285/os-volume_attachments => generated 194 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:31:47.695579 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-766c7944-c103-45c1-a749-d90f0304667e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:47.696159 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-766c7944-c103-45c1-a749-d90f0304667e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:47.704325 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-766c7944-c103-45c1-a749-d90f0304667e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:47.706292 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-766c7944-c103-45c1-a749-d90f0304667e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:47.707368 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-766c7944-c103-45c1-a749-d90f0304667e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:47.709650 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-766c7944-c103-45c1-a749-d90f0304667e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:47.711122 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-766c7944-c103-45c1-a749-d90f0304667e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:47.711989 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-766c7944-c103-45c1-a749-d90f0304667e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:47.993260 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-766c7944-c103-45c1-a749-d90f0304667e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:48.006722 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-766c7944-c103-45c1-a749-d90f0304667e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:48.008467 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-766c7944-c103-45c1-a749-d90f0304667e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:48.013152 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-766c7944-c103-45c1-a749-d90f0304667e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1724 microversion: 2.20 time: 0.321338 Aug 31 12:31:48.015155 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 107/227] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:31:47 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1724 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:31:48.069101 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-aeb731c8-b1dc-4fe3-aac2-f5d8c0e649e2 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:48.070589 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-aeb731c8-b1dc-4fe3-aac2-f5d8c0e649e2 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:48.086903 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-aeb731c8-b1dc-4fe3-aac2-f5d8c0e649e2 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:48.087807 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-aeb731c8-b1dc-4fe3-aac2-f5d8c0e649e2 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:48.088589 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-aeb731c8-b1dc-4fe3-aac2-f5d8c0e649e2 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:48.090970 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-aeb731c8-b1dc-4fe3-aac2-f5d8c0e649e2 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:48.092486 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-aeb731c8-b1dc-4fe3-aac2-f5d8c0e649e2 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:48.093641 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-aeb731c8-b1dc-4fe3-aac2-f5d8c0e649e2 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:48.313494 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-aeb731c8-b1dc-4fe3-aac2-f5d8c0e649e2 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:48.328373 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-aeb731c8-b1dc-4fe3-aac2-f5d8c0e649e2 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1521 microversion: 2.1 time: 0.265623 Aug 31 12:31:48.329624 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 121/228] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:48 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:49.046229 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-7416801c-629d-45d3-80d8-10a9fb000d65 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:49.048449 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-7416801c-629d-45d3-80d8-10a9fb000d65 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:49.067911 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7416801c-629d-45d3-80d8-10a9fb000d65 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:49.070057 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7416801c-629d-45d3-80d8-10a9fb000d65 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:49.072278 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7416801c-629d-45d3-80d8-10a9fb000d65 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:49.073759 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7416801c-629d-45d3-80d8-10a9fb000d65 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:49.074244 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7416801c-629d-45d3-80d8-10a9fb000d65 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:49.074678 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7416801c-629d-45d3-80d8-10a9fb000d65 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:49.345091 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-7416801c-629d-45d3-80d8-10a9fb000d65 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:49.368222 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-7416801c-629d-45d3-80d8-10a9fb000d65 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:49.370625 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-7416801c-629d-45d3-80d8-10a9fb000d65 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:49.372580 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-7416801c-629d-45d3-80d8-10a9fb000d65 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1724 microversion: 2.20 time: 0.335944 Aug 31 12:31:49.373770 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 108/229] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:31:49 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1724 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:31:49.377024 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-78d2e14d-8c14-4a5c-bf34-e6ee831c61e3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:49.378617 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-78d2e14d-8c14-4a5c-bf34-e6ee831c61e3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:49.425630 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-78d2e14d-8c14-4a5c-bf34-e6ee831c61e3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:49.427215 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-78d2e14d-8c14-4a5c-bf34-e6ee831c61e3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:49.429020 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-78d2e14d-8c14-4a5c-bf34-e6ee831c61e3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:49.429782 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-78d2e14d-8c14-4a5c-bf34-e6ee831c61e3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:49.430250 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-78d2e14d-8c14-4a5c-bf34-e6ee831c61e3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:49.438995 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-78d2e14d-8c14-4a5c-bf34-e6ee831c61e3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:49.669041 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-78d2e14d-8c14-4a5c-bf34-e6ee831c61e3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:49.679814 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-78d2e14d-8c14-4a5c-bf34-e6ee831c61e3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1521 microversion: 2.1 time: 0.309818 Aug 31 12:31:49.680401 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 122/230] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:49 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:31:50.400322 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-198d83cb-2b6c-4646-9007-66dfd57f69b7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:50.401196 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-198d83cb-2b6c-4646-9007-66dfd57f69b7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:50.408540 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-198d83cb-2b6c-4646-9007-66dfd57f69b7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:50.409268 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-198d83cb-2b6c-4646-9007-66dfd57f69b7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:50.409698 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-198d83cb-2b6c-4646-9007-66dfd57f69b7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:50.410459 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-198d83cb-2b6c-4646-9007-66dfd57f69b7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:50.411277 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-198d83cb-2b6c-4646-9007-66dfd57f69b7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:50.411695 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-198d83cb-2b6c-4646-9007-66dfd57f69b7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:50.631384 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-198d83cb-2b6c-4646-9007-66dfd57f69b7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:50.678064 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-198d83cb-2b6c-4646-9007-66dfd57f69b7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:50.687758 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-198d83cb-2b6c-4646-9007-66dfd57f69b7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:50.708160 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-e2577a63-f3d7-4854-a9f1-4b244612bcdf tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:50.711403 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-198d83cb-2b6c-4646-9007-66dfd57f69b7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1724 microversion: 2.20 time: 0.300465 Aug 31 12:31:50.715837 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-e2577a63-f3d7-4854-a9f1-4b244612bcdf tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:50.717023 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 109/231] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:31:50 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1724 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:31:50.746424 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2577a63-f3d7-4854-a9f1-4b244612bcdf tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:50.747622 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2577a63-f3d7-4854-a9f1-4b244612bcdf tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:50.750969 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2577a63-f3d7-4854-a9f1-4b244612bcdf tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:50.752073 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2577a63-f3d7-4854-a9f1-4b244612bcdf tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:50.758625 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2577a63-f3d7-4854-a9f1-4b244612bcdf tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:50.759876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2577a63-f3d7-4854-a9f1-4b244612bcdf tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:50.812612 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:51.099336 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-e2577a63-f3d7-4854-a9f1-4b244612bcdf tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:51.113766 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-e2577a63-f3d7-4854-a9f1-4b244612bcdf tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1521 microversion: 2.1 time: 0.413110 Aug 31 12:31:51.115913 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 123/232] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:50 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1521 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:31:51.753626 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-105d918f-77d7-4725-bee7-4c2cef0d8f0d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:51.755957 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-105d918f-77d7-4725-bee7-4c2cef0d8f0d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:51.768230 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-105d918f-77d7-4725-bee7-4c2cef0d8f0d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:51.769475 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-105d918f-77d7-4725-bee7-4c2cef0d8f0d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:51.770249 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-105d918f-77d7-4725-bee7-4c2cef0d8f0d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:51.771525 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-105d918f-77d7-4725-bee7-4c2cef0d8f0d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:51.772308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-105d918f-77d7-4725-bee7-4c2cef0d8f0d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:51.773279 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-105d918f-77d7-4725-bee7-4c2cef0d8f0d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:52.039515 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-105d918f-77d7-4725-bee7-4c2cef0d8f0d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:52.051164 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-105d918f-77d7-4725-bee7-4c2cef0d8f0d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:52.052721 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-105d918f-77d7-4725-bee7-4c2cef0d8f0d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:52.054223 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-105d918f-77d7-4725-bee7-4c2cef0d8f0d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1724 microversion: 2.20 time: 0.309089 Aug 31 12:31:52.054813 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 110/233] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:31:51 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:31:52.151820 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-18da7358-f767-4079-8acf-a340a3be4b3d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:52.152582 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-18da7358-f767-4079-8acf-a340a3be4b3d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:52.160341 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-18da7358-f767-4079-8acf-a340a3be4b3d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:52.160879 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-18da7358-f767-4079-8acf-a340a3be4b3d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:52.161397 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-18da7358-f767-4079-8acf-a340a3be4b3d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:52.162239 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-18da7358-f767-4079-8acf-a340a3be4b3d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:52.162694 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-18da7358-f767-4079-8acf-a340a3be4b3d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:52.163143 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-18da7358-f767-4079-8acf-a340a3be4b3d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:52.382418 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-18da7358-f767-4079-8acf-a340a3be4b3d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:52.392562 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-18da7358-f767-4079-8acf-a340a3be4b3d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1521 microversion: 2.1 time: 0.244796 Aug 31 12:31:52.393174 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 124/234] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:52 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:53.096859 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-69b6853d-971f-47e5-9c0f-87b1d9b7a83e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:53.097663 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-69b6853d-971f-47e5-9c0f-87b1d9b7a83e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:53.104315 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-69b6853d-971f-47e5-9c0f-87b1d9b7a83e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:53.105987 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-69b6853d-971f-47e5-9c0f-87b1d9b7a83e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:53.106440 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-69b6853d-971f-47e5-9c0f-87b1d9b7a83e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:53.107461 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-69b6853d-971f-47e5-9c0f-87b1d9b7a83e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:53.107929 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-69b6853d-971f-47e5-9c0f-87b1d9b7a83e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:53.108359 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-69b6853d-971f-47e5-9c0f-87b1d9b7a83e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:53.287439 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-69b6853d-971f-47e5-9c0f-87b1d9b7a83e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:53.296352 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-69b6853d-971f-47e5-9c0f-87b1d9b7a83e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:53.298102 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-69b6853d-971f-47e5-9c0f-87b1d9b7a83e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:53.299343 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-69b6853d-971f-47e5-9c0f-87b1d9b7a83e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1724 microversion: 2.20 time: 0.206608 Aug 31 12:31:53.300116 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 111/235] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:31:53 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:31:53.425981 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-21550bc9-5158-4826-8411-a52798341e7c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:53.426941 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-21550bc9-5158-4826-8411-a52798341e7c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:53.434952 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-21550bc9-5158-4826-8411-a52798341e7c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:53.435467 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-21550bc9-5158-4826-8411-a52798341e7c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:53.435912 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-21550bc9-5158-4826-8411-a52798341e7c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:53.436648 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-21550bc9-5158-4826-8411-a52798341e7c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:53.437301 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-21550bc9-5158-4826-8411-a52798341e7c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:53.437740 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-21550bc9-5158-4826-8411-a52798341e7c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:53.627918 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-21550bc9-5158-4826-8411-a52798341e7c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:53.640177 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-21550bc9-5158-4826-8411-a52798341e7c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1521 microversion: 2.1 time: 0.218335 Aug 31 12:31:53.640759 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 125/236] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:53 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:54.322834 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-49406869-deaf-4502-a9f9-7eda7c4177a3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:54.323580 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-49406869-deaf-4502-a9f9-7eda7c4177a3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:54.325716 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_api:SELECT=38 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:54.331464 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-49406869-deaf-4502-a9f9-7eda7c4177a3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:54.332912 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-49406869-deaf-4502-a9f9-7eda7c4177a3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:54.332912 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-49406869-deaf-4502-a9f9-7eda7c4177a3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:54.333228 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-49406869-deaf-4502-a9f9-7eda7c4177a3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:54.333500 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-49406869-deaf-4502-a9f9-7eda7c4177a3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:54.333923 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-49406869-deaf-4502-a9f9-7eda7c4177a3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:54.526877 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-49406869-deaf-4502-a9f9-7eda7c4177a3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:54.540936 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-49406869-deaf-4502-a9f9-7eda7c4177a3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:54.544067 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-49406869-deaf-4502-a9f9-7eda7c4177a3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:54.546323 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-49406869-deaf-4502-a9f9-7eda7c4177a3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1724 microversion: 2.20 time: 0.227087 Aug 31 12:31:54.547371 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 112/237] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:31:54 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:31:54.662895 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-1476bed1-c070-45bb-9a4c-5e464e53087e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:54.663554 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-1476bed1-c070-45bb-9a4c-5e464e53087e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:54.671315 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1476bed1-c070-45bb-9a4c-5e464e53087e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:54.671854 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1476bed1-c070-45bb-9a4c-5e464e53087e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:54.672496 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1476bed1-c070-45bb-9a4c-5e464e53087e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:54.673245 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1476bed1-c070-45bb-9a4c-5e464e53087e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:54.673823 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1476bed1-c070-45bb-9a4c-5e464e53087e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:54.674324 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1476bed1-c070-45bb-9a4c-5e464e53087e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:54.844503 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-1476bed1-c070-45bb-9a4c-5e464e53087e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:54.855678 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-1476bed1-c070-45bb-9a4c-5e464e53087e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1521 microversion: 2.1 time: 0.197388 Aug 31 12:31:54.856307 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 126/238] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:54 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:31:55.575881 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-9654c162-fdb9-4c42-8fa8-5046cb545cf7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:55.576520 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-9654c162-fdb9-4c42-8fa8-5046cb545cf7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:55.588194 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9654c162-fdb9-4c42-8fa8-5046cb545cf7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:55.590871 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9654c162-fdb9-4c42-8fa8-5046cb545cf7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:55.591634 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9654c162-fdb9-4c42-8fa8-5046cb545cf7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:55.593157 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9654c162-fdb9-4c42-8fa8-5046cb545cf7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:55.593944 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9654c162-fdb9-4c42-8fa8-5046cb545cf7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:55.595035 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9654c162-fdb9-4c42-8fa8-5046cb545cf7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:55.896253 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-81ef9c55-15ff-4238-a3d3-2c035cb30764 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:55.899340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-81ef9c55-15ff-4238-a3d3-2c035cb30764 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:55.916664 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-81ef9c55-15ff-4238-a3d3-2c035cb30764 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:55.918730 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-81ef9c55-15ff-4238-a3d3-2c035cb30764 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:55.919918 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-81ef9c55-15ff-4238-a3d3-2c035cb30764 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:55.921431 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-81ef9c55-15ff-4238-a3d3-2c035cb30764 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:55.922377 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-81ef9c55-15ff-4238-a3d3-2c035cb30764 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:55.923288 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-81ef9c55-15ff-4238-a3d3-2c035cb30764 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:56.043341 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-9654c162-fdb9-4c42-8fa8-5046cb545cf7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:56.054648 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-9654c162-fdb9-4c42-8fa8-5046cb545cf7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:56.056145 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-9654c162-fdb9-4c42-8fa8-5046cb545cf7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:56.057389 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-9654c162-fdb9-4c42-8fa8-5046cb545cf7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1724 microversion: 2.20 time: 0.489155 Aug 31 12:31:56.057981 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 113/239] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:31:55 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1724 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:31:56.172291 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-81ef9c55-15ff-4238-a3d3-2c035cb30764 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:56.180914 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-81ef9c55-15ff-4238-a3d3-2c035cb30764 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1521 microversion: 2.1 time: 0.305089 Aug 31 12:31:56.181574 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 127/240] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:55 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:57.085754 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-d95f850b-a98f-4486-96ce-40a53043e6ee tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:57.086293 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-d95f850b-a98f-4486-96ce-40a53043e6ee tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:57.094271 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d95f850b-a98f-4486-96ce-40a53043e6ee tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:57.094953 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d95f850b-a98f-4486-96ce-40a53043e6ee tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:57.095685 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d95f850b-a98f-4486-96ce-40a53043e6ee tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:57.096831 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d95f850b-a98f-4486-96ce-40a53043e6ee tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:57.097402 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d95f850b-a98f-4486-96ce-40a53043e6ee tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:57.097921 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d95f850b-a98f-4486-96ce-40a53043e6ee tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:57.217868 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-eb523417-d7f8-4b66-94f2-46f36dceb9e7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:57.218560 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-eb523417-d7f8-4b66-94f2-46f36dceb9e7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:57.225150 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-eb523417-d7f8-4b66-94f2-46f36dceb9e7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:57.225653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-eb523417-d7f8-4b66-94f2-46f36dceb9e7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:57.226093 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-eb523417-d7f8-4b66-94f2-46f36dceb9e7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:57.226801 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-eb523417-d7f8-4b66-94f2-46f36dceb9e7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:57.227363 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-eb523417-d7f8-4b66-94f2-46f36dceb9e7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:57.228256 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-eb523417-d7f8-4b66-94f2-46f36dceb9e7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:57.286204 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-d95f850b-a98f-4486-96ce-40a53043e6ee tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:57.297087 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-d95f850b-a98f-4486-96ce-40a53043e6ee tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:57.298236 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-d95f850b-a98f-4486-96ce-40a53043e6ee tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:57.299501 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-d95f850b-a98f-4486-96ce-40a53043e6ee tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1724 microversion: 2.20 time: 0.219241 Aug 31 12:31:57.300335 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 114/241] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:31:57 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:31:57.415237 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-eb523417-d7f8-4b66-94f2-46f36dceb9e7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:57.428086 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-eb523417-d7f8-4b66-94f2-46f36dceb9e7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1521 microversion: 2.1 time: 0.215365 Aug 31 12:31:57.428919 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 128/242] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:57 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:31:58.327837 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-d7b17f5e-2dc9-4913-8002-379e17d41494 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:58.329579 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-d7b17f5e-2dc9-4913-8002-379e17d41494 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:58.337553 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d7b17f5e-2dc9-4913-8002-379e17d41494 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:58.338043 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d7b17f5e-2dc9-4913-8002-379e17d41494 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:58.338474 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d7b17f5e-2dc9-4913-8002-379e17d41494 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:58.339931 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d7b17f5e-2dc9-4913-8002-379e17d41494 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:58.340689 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d7b17f5e-2dc9-4913-8002-379e17d41494 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:58.340879 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d7b17f5e-2dc9-4913-8002-379e17d41494 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:58.459789 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-fe9c74f6-a9a3-4401-80b4-0c64cbdead96 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:58.460397 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-fe9c74f6-a9a3-4401-80b4-0c64cbdead96 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:58.463023 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_api:SELECT=39 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:58.470638 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fe9c74f6-a9a3-4401-80b4-0c64cbdead96 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:58.472172 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fe9c74f6-a9a3-4401-80b4-0c64cbdead96 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:58.472720 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fe9c74f6-a9a3-4401-80b4-0c64cbdead96 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:58.473585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fe9c74f6-a9a3-4401-80b4-0c64cbdead96 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:58.474119 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fe9c74f6-a9a3-4401-80b4-0c64cbdead96 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:58.474547 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fe9c74f6-a9a3-4401-80b4-0c64cbdead96 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:58.546048 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-d7b17f5e-2dc9-4913-8002-379e17d41494 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:58.579345 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-d7b17f5e-2dc9-4913-8002-379e17d41494 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:58.603212 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-d7b17f5e-2dc9-4913-8002-379e17d41494 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:58.605497 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-d7b17f5e-2dc9-4913-8002-379e17d41494 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1724 microversion: 2.20 time: 0.282279 Aug 31 12:31:58.608948 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 115/243] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:31:58 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1724 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:31:58.761400 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-fe9c74f6-a9a3-4401-80b4-0c64cbdead96 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:31:58.780805 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-fe9c74f6-a9a3-4401-80b4-0c64cbdead96 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1521 microversion: 2.1 time: 0.324459 Aug 31 12:31:58.791113 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 129/244] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:58 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:31:59.648653 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-81d17267-e6d0-4547-8ade-638885fd46fc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:59.648653 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-81d17267-e6d0-4547-8ade-638885fd46fc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:59.660180 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-81d17267-e6d0-4547-8ade-638885fd46fc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:59.660970 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-81d17267-e6d0-4547-8ade-638885fd46fc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:59.661693 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-81d17267-e6d0-4547-8ade-638885fd46fc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:59.663336 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-81d17267-e6d0-4547-8ade-638885fd46fc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:59.664135 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-81d17267-e6d0-4547-8ade-638885fd46fc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:59.680417 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-81d17267-e6d0-4547-8ade-638885fd46fc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:59.811817 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-f4430d7a-0c8c-4e53-8575-454d5ffc4995 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:59.814040 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-f4430d7a-0c8c-4e53-8575-454d5ffc4995 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:59.824625 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f4430d7a-0c8c-4e53-8575-454d5ffc4995 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:59.825143 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f4430d7a-0c8c-4e53-8575-454d5ffc4995 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:59.825564 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f4430d7a-0c8c-4e53-8575-454d5ffc4995 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:59.828949 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f4430d7a-0c8c-4e53-8575-454d5ffc4995 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:59.829517 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f4430d7a-0c8c-4e53-8575-454d5ffc4995 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:59.829950 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f4430d7a-0c8c-4e53-8575-454d5ffc4995 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:00.037347 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-81d17267-e6d0-4547-8ade-638885fd46fc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:00.049780 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-81d17267-e6d0-4547-8ade-638885fd46fc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:00.052735 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-81d17267-e6d0-4547-8ade-638885fd46fc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:00.055328 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-81d17267-e6d0-4547-8ade-638885fd46fc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1724 microversion: 2.20 time: 0.422597 Aug 31 12:32:00.056662 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 116/245] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:31:59 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1724 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:00.065986 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-5edabca1-11cb-49f2-b56a-821dffe06be5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:32:00.075983 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5edabca1-11cb-49f2-b56a-821dffe06be5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:00.076468 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5edabca1-11cb-49f2-b56a-821dffe06be5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:00.077088 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5edabca1-11cb-49f2-b56a-821dffe06be5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:00.082409 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-f4430d7a-0c8c-4e53-8575-454d5ffc4995 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:00.097009 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-f4430d7a-0c8c-4e53-8575-454d5ffc4995 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1521 microversion: 2.1 time: 0.289381 Aug 31 12:32:00.097673 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 130/246] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:31:59 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:32:00.156527 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-5edabca1-11cb-49f2-b56a-821dffe06be5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Going to try to stop instance {{(pid=120750) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 12:32:00.205379 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:00.218650 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-5edabca1-11cb-49f2-b56a-821dffe06be5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "POST /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285/action" status: 202 len: 0 microversion: 2.1 time: 0.159476 Aug 31 12:32:00.219615 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 117/247] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Aug 31 12:32:00 2022] POST /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:32:00.232681 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-a4438a12-aaf3-474e-9ac4-f24aaed7a2ac tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:00.233463 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-a4438a12-aaf3-474e-9ac4-f24aaed7a2ac tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:00.240358 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a4438a12-aaf3-474e-9ac4-f24aaed7a2ac tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:00.240932 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a4438a12-aaf3-474e-9ac4-f24aaed7a2ac tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:00.241575 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a4438a12-aaf3-474e-9ac4-f24aaed7a2ac tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:00.242283 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a4438a12-aaf3-474e-9ac4-f24aaed7a2ac tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:00.243273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a4438a12-aaf3-474e-9ac4-f24aaed7a2ac tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:00.243889 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a4438a12-aaf3-474e-9ac4-f24aaed7a2ac tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:00.422935 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-a4438a12-aaf3-474e-9ac4-f24aaed7a2ac tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:00.433237 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-a4438a12-aaf3-474e-9ac4-f24aaed7a2ac tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1722 microversion: 2.1 time: 0.207917 Aug 31 12:32:00.434049 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 131/248] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:00 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:01.087797 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-a6f3674f-87e7-4959-8f04-97a03a7aeb1f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:01.090003 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-a6f3674f-87e7-4959-8f04-97a03a7aeb1f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:01.102159 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a6f3674f-87e7-4959-8f04-97a03a7aeb1f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:01.102984 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a6f3674f-87e7-4959-8f04-97a03a7aeb1f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:01.103709 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a6f3674f-87e7-4959-8f04-97a03a7aeb1f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:01.105654 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a6f3674f-87e7-4959-8f04-97a03a7aeb1f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:01.106434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a6f3674f-87e7-4959-8f04-97a03a7aeb1f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:01.107442 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a6f3674f-87e7-4959-8f04-97a03a7aeb1f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:01.131950 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-3f2288aa-dec3-40d8-80df-1a766619e92c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:01.131950 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-3f2288aa-dec3-40d8-80df-1a766619e92c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:01.143295 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3f2288aa-dec3-40d8-80df-1a766619e92c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:01.144566 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3f2288aa-dec3-40d8-80df-1a766619e92c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:01.145609 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3f2288aa-dec3-40d8-80df-1a766619e92c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:01.147465 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3f2288aa-dec3-40d8-80df-1a766619e92c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:01.148552 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3f2288aa-dec3-40d8-80df-1a766619e92c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:01.149649 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3f2288aa-dec3-40d8-80df-1a766619e92c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:01.319020 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-a6f3674f-87e7-4959-8f04-97a03a7aeb1f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:01.328804 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-a6f3674f-87e7-4959-8f04-97a03a7aeb1f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:01.330694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-a6f3674f-87e7-4959-8f04-97a03a7aeb1f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:01.332279 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-a6f3674f-87e7-4959-8f04-97a03a7aeb1f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1724 microversion: 2.20 time: 0.254250 Aug 31 12:32:01.333261 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 118/249] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:01 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:01.342385 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-3f2288aa-dec3-40d8-80df-1a766619e92c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:01.351660 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-3f2288aa-dec3-40d8-80df-1a766619e92c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1521 microversion: 2.1 time: 0.234087 Aug 31 12:32:01.352534 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 132/250] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:01 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:01.455680 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-f2534c1c-1c7d-4451-8584-cacfba7c6cc0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:01.456295 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-f2534c1c-1c7d-4451-8584-cacfba7c6cc0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:01.466254 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f2534c1c-1c7d-4451-8584-cacfba7c6cc0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:01.466747 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f2534c1c-1c7d-4451-8584-cacfba7c6cc0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:01.467209 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f2534c1c-1c7d-4451-8584-cacfba7c6cc0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:01.467909 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f2534c1c-1c7d-4451-8584-cacfba7c6cc0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:01.468393 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f2534c1c-1c7d-4451-8584-cacfba7c6cc0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:01.468813 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f2534c1c-1c7d-4451-8584-cacfba7c6cc0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:01.773273 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f2534c1c-1c7d-4451-8584-cacfba7c6cc0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:01.788728 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-f2534c1c-1c7d-4451-8584-cacfba7c6cc0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1722 microversion: 2.1 time: 0.337440 Aug 31 12:32:01.789817 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 119/251] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:01 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1722 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:02.378128 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-6686fe7c-088f-40a1-82ba-c486df883220 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:02.379132 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-6686fe7c-088f-40a1-82ba-c486df883220 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:02.386664 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6686fe7c-088f-40a1-82ba-c486df883220 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:02.387229 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6686fe7c-088f-40a1-82ba-c486df883220 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:02.387714 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6686fe7c-088f-40a1-82ba-c486df883220 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:02.388721 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6686fe7c-088f-40a1-82ba-c486df883220 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:02.389482 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6686fe7c-088f-40a1-82ba-c486df883220 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:02.390120 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6686fe7c-088f-40a1-82ba-c486df883220 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:02.416163 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-b7ceed1e-fb6d-4d5b-8fb8-d43835967b5d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:02.416963 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-b7ceed1e-fb6d-4d5b-8fb8-d43835967b5d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:02.452223 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b7ceed1e-fb6d-4d5b-8fb8-d43835967b5d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:02.453298 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b7ceed1e-fb6d-4d5b-8fb8-d43835967b5d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:02.454122 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b7ceed1e-fb6d-4d5b-8fb8-d43835967b5d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:02.457025 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b7ceed1e-fb6d-4d5b-8fb8-d43835967b5d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:02.457966 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b7ceed1e-fb6d-4d5b-8fb8-d43835967b5d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:02.458617 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b7ceed1e-fb6d-4d5b-8fb8-d43835967b5d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:02.661051 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-6686fe7c-088f-40a1-82ba-c486df883220 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:02.669594 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-b7ceed1e-fb6d-4d5b-8fb8-d43835967b5d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:02.671441 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-6686fe7c-088f-40a1-82ba-c486df883220 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1521 microversion: 2.1 time: 0.296669 Aug 31 12:32:02.673985 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 120/252] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:02 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:02.683220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-b7ceed1e-fb6d-4d5b-8fb8-d43835967b5d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:02.684684 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-b7ceed1e-fb6d-4d5b-8fb8-d43835967b5d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:02.685858 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-b7ceed1e-fb6d-4d5b-8fb8-d43835967b5d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1724 microversion: 2.20 time: 0.332097 Aug 31 12:32:02.686708 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 133/253] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:02 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1724 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:02.830728 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-1070715f-cdf6-413f-9b81-75fbfada2c0d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:02.832307 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-1070715f-cdf6-413f-9b81-75fbfada2c0d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:02.850294 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1070715f-cdf6-413f-9b81-75fbfada2c0d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:02.851725 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1070715f-cdf6-413f-9b81-75fbfada2c0d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:02.852841 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1070715f-cdf6-413f-9b81-75fbfada2c0d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:02.855197 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1070715f-cdf6-413f-9b81-75fbfada2c0d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:02.857267 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1070715f-cdf6-413f-9b81-75fbfada2c0d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:02.858837 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1070715f-cdf6-413f-9b81-75fbfada2c0d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:03.078012 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-1070715f-cdf6-413f-9b81-75fbfada2c0d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:03.097117 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-1070715f-cdf6-413f-9b81-75fbfada2c0d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1722 microversion: 2.1 time: 0.273493 Aug 31 12:32:03.099058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 121/254] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:02 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:03.695834 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-90f661ab-402d-46d5-a040-3cd8f3d2d26f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:03.696639 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-90f661ab-402d-46d5-a040-3cd8f3d2d26f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:03.710444 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-f63a6540-a519-4fd5-addc-0d16bbeebe88 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:03.711084 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-f63a6540-a519-4fd5-addc-0d16bbeebe88 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:03.717870 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-90f661ab-402d-46d5-a040-3cd8f3d2d26f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:03.722015 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f63a6540-a519-4fd5-addc-0d16bbeebe88 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:03.722544 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f63a6540-a519-4fd5-addc-0d16bbeebe88 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:03.724216 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-90f661ab-402d-46d5-a040-3cd8f3d2d26f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:03.724862 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-90f661ab-402d-46d5-a040-3cd8f3d2d26f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:03.726282 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-90f661ab-402d-46d5-a040-3cd8f3d2d26f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:03.726891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-90f661ab-402d-46d5-a040-3cd8f3d2d26f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:03.727597 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-90f661ab-402d-46d5-a040-3cd8f3d2d26f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:03.735816 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f63a6540-a519-4fd5-addc-0d16bbeebe88 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:03.737485 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f63a6540-a519-4fd5-addc-0d16bbeebe88 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:03.738727 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f63a6540-a519-4fd5-addc-0d16bbeebe88 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:03.739845 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f63a6540-a519-4fd5-addc-0d16bbeebe88 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:04.060253 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f63a6540-a519-4fd5-addc-0d16bbeebe88 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:04.071991 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f63a6540-a519-4fd5-addc-0d16bbeebe88 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:04.073922 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f63a6540-a519-4fd5-addc-0d16bbeebe88 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:04.075510 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-f63a6540-a519-4fd5-addc-0d16bbeebe88 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1724 microversion: 2.20 time: 0.369775 Aug 31 12:32:04.076105 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 122/255] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:03 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1724 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:32:04.124176 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-fe8f69f7-e2c0-4912-a5f4-ce6e6fca9f21 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:04.124790 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-fe8f69f7-e2c0-4912-a5f4-ce6e6fca9f21 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:04.132724 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fe8f69f7-e2c0-4912-a5f4-ce6e6fca9f21 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:04.133250 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fe8f69f7-e2c0-4912-a5f4-ce6e6fca9f21 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:04.133759 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fe8f69f7-e2c0-4912-a5f4-ce6e6fca9f21 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:04.134497 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fe8f69f7-e2c0-4912-a5f4-ce6e6fca9f21 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:04.135012 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fe8f69f7-e2c0-4912-a5f4-ce6e6fca9f21 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:04.135598 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fe8f69f7-e2c0-4912-a5f4-ce6e6fca9f21 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:04.379261 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-fe8f69f7-e2c0-4912-a5f4-ce6e6fca9f21 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:04.405827 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-fe8f69f7-e2c0-4912-a5f4-ce6e6fca9f21 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1722 microversion: 2.1 time: 0.287379 Aug 31 12:32:04.407334 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 123/256] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:04 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1722 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:04.478840 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-90f661ab-402d-46d5-a040-3cd8f3d2d26f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:04.491652 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-90f661ab-402d-46d5-a040-3cd8f3d2d26f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1521 microversion: 2.1 time: 0.800335 Aug 31 12:32:04.515135 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 134/257] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:03 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1521 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:05.113568 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-22199c24-b52c-435b-8a75-089cd40b0bdf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:05.115678 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-22199c24-b52c-435b-8a75-089cd40b0bdf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:05.143345 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-22199c24-b52c-435b-8a75-089cd40b0bdf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:05.144714 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-22199c24-b52c-435b-8a75-089cd40b0bdf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:05.145870 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-22199c24-b52c-435b-8a75-089cd40b0bdf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:05.147276 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-22199c24-b52c-435b-8a75-089cd40b0bdf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:05.150696 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-22199c24-b52c-435b-8a75-089cd40b0bdf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:05.151659 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-22199c24-b52c-435b-8a75-089cd40b0bdf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:05.436678 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-d0c497b4-6ad6-4a1b-a403-c1895dd5acd8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:05.437509 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-d0c497b4-6ad6-4a1b-a403-c1895dd5acd8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:05.456202 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d0c497b4-6ad6-4a1b-a403-c1895dd5acd8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:05.459348 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d0c497b4-6ad6-4a1b-a403-c1895dd5acd8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:05.461975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d0c497b4-6ad6-4a1b-a403-c1895dd5acd8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:05.463043 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d0c497b4-6ad6-4a1b-a403-c1895dd5acd8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:05.465250 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d0c497b4-6ad6-4a1b-a403-c1895dd5acd8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:05.467334 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d0c497b4-6ad6-4a1b-a403-c1895dd5acd8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:05.512707 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-22199c24-b52c-435b-8a75-089cd40b0bdf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:05.526028 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-22199c24-b52c-435b-8a75-089cd40b0bdf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:05.528959 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-22199c24-b52c-435b-8a75-089cd40b0bdf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:05.530544 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-22199c24-b52c-435b-8a75-089cd40b0bdf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1724 microversion: 2.20 time: 0.433386 Aug 31 12:32:05.531719 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 124/258] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:05 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1724 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:05.536792 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-3dd6e2d7-1fdf-48ab-8c30-e80c5870d7b0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:05.537404 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-3dd6e2d7-1fdf-48ab-8c30-e80c5870d7b0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:05.545046 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3dd6e2d7-1fdf-48ab-8c30-e80c5870d7b0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:05.545623 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3dd6e2d7-1fdf-48ab-8c30-e80c5870d7b0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:05.546150 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3dd6e2d7-1fdf-48ab-8c30-e80c5870d7b0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:05.546883 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3dd6e2d7-1fdf-48ab-8c30-e80c5870d7b0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:05.547358 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3dd6e2d7-1fdf-48ab-8c30-e80c5870d7b0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:05.547780 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3dd6e2d7-1fdf-48ab-8c30-e80c5870d7b0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:05.720989 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-3dd6e2d7-1fdf-48ab-8c30-e80c5870d7b0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:05.730080 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-3dd6e2d7-1fdf-48ab-8c30-e80c5870d7b0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1501 microversion: 2.1 time: 0.196901 Aug 31 12:32:05.731464 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 125/259] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:05 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1501 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:05.733733 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-d0c497b4-6ad6-4a1b-a403-c1895dd5acd8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:05.744275 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-d0c497b4-6ad6-4a1b-a403-c1895dd5acd8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1722 microversion: 2.1 time: 0.318711 Aug 31 12:32:05.745837 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 135/260] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:05 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1722 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:05.769976 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-ecc3563e-21d0-4438-bf4b-51277d4b6e20 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1cdc89b-55bd-4c88-a566-873a5406d88e"}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:32:05.775074 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-ecc3563e-21d0-4438-bf4b-51277d4b6e20 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:05.786808 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ecc3563e-21d0-4438-bf4b-51277d4b6e20 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:05.788120 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ecc3563e-21d0-4438-bf4b-51277d4b6e20 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:05.789183 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ecc3563e-21d0-4438-bf4b-51277d4b6e20 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:05.790509 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ecc3563e-21d0-4438-bf4b-51277d4b6e20 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:05.791439 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ecc3563e-21d0-4438-bf4b-51277d4b6e20 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:05.792481 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ecc3563e-21d0-4438-bf4b-51277d4b6e20 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:05.841927 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-ecc3563e-21d0-4438-bf4b-51277d4b6e20 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] HTTP exception thrown: Cannot 'attach_volume' instance bbae24ec-b404-415c-97a7-a78cd28ff068 while it is in vm_state rescued Aug 31 12:32:05.844251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-ecc3563e-21d0-4438-bf4b-51277d4b6e20 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Request method failure captured: Aug 31 12:32:05.844251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: POST /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068/os-volume_attachments HTTP/1.1 Aug 31 12:32:05.844251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:32:05.844251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:32:05.844251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:32:05.844251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 74 Aug 31 12:32:05.844251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:32:05.844251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:32:05.844251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:32:05.844251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:32:05.844251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1Q7JmiC9D834ocUdlCNr9HFRkA87wJ_FnUzJGxT5zTT8rU_zms7dDN50ARDsmwlrghc2tCu0r2wB4GfrFjOoimGbd6UfedSwZbznp9qT7fwLaJQHObEsIlJw2EeYd6b0WddqHNk8K0X0vyDMsTdb6In3CN19MqWaCjmEyAxCldxgtw Aug 31 12:32:05.844251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:32:05.844251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:32:05.844251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:32:05.844251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:32:05.844251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:32:05.844251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:32:05.844251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: 7327d2f6422e4bdb9e250e44987dace3 Aug 31 12:32:05.844251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-274391016 Aug 31 12:32:05.844251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:32:05.844251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:32:05.845888 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7327d2f6422e4bdb9e250e44987dace3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7327d2f6422e4bdb9e250e44987dace3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7327d2f6422e4bdb9e250e44987dace3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7327d2f6422e4bdb9e250e44987dace3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:32:05.845888 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-ServerRescueNegativeTestJSON-274391016 Aug 31 12:32:05.845888 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: 7327d2f6422e4bdb9e250e44987dace3 Aug 31 12:32:05.845888 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-274391016 Aug 31 12:32:05.845888 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-ServerRescueNegativeTestJSON-274391016-project Aug 31 12:32:05.845888 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:32:05.845888 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:32:05.845888 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: 64886d73c79649d1a824170a33f53fcb Aug 31 12:32:05.845888 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-ServerRescueNegativeTestJSON-274391016-project Aug 31 12:32:05.845888 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Aug 31 12:32:05.845888 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {"volumeAttachment": {"volumeId": "f1cdc89b-55bd-4c88-a566-873a5406d88e"}} Aug 31 12:32:05.845888 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:32:05.846827 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Cannot 'attach_volume' instance bbae24ec-b404-415c-97a7-a78cd28ff068 while it is in vm_state rescued Aug 31 12:32:05.846827 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'server_id': 'bbae24ec-b404-415c-97a7-a78cd28ff068', 'body': {'volumeAttachment': {'volumeId': 'f1cdc89b-55bd-4c88-a566-873a5406d88e'}}} Aug 31 12:32:05.846827 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:32:05.846827 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:32:05.846827 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 12:32:05.846827 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 12:32:05.846827 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 12:32:05.846827 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 12:32:05.846827 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 12:32:05.846827 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 12:32:05.846827 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bbae24ec-b404-415c-97a7-a78cd28ff068 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 31 12:32:05.846827 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:32:05.846827 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:32:05.846827 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:32:05.846827 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:32:05.846827 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:32:05.846827 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:32:05.846827 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:32:05.846827 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:32:05.848313 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:32:05.848313 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:32:05.848313 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 12:32:05.848313 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 12:32:05.848313 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 12:32:05.848313 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 12:32:05.848313 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 12:32:05.848313 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 12:32:05.848313 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 31 12:32:05.848313 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 12:32:05.848313 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 12:32:05.848313 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 12:32:05.848313 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance bbae24ec-b404-415c-97a7-a78cd28ff068 while it is in vm_state rescued Aug 31 12:32:05.848313 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:32:05.848313 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:32:05.848313 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:32:05.848313 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:32:05.848313 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:32:05.848313 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:32:05.849821 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:32:05.849821 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:32:05.849821 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance bbae24ec-b404-415c-97a7-a78cd28ff068 while it is in vm_state rescued Aug 31 12:32:05.849821 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:32:05.851545 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-ecc3563e-21d0-4438-bf4b-51277d4b6e20 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Returning 409 to user: Cannot 'attach_volume' instance bbae24ec-b404-415c-97a7-a78cd28ff068 while it is in vm_state rescued {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:32:05.853321 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-ecc3563e-21d0-4438-bf4b-51277d4b6e20 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "POST /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.091210 Aug 31 12:32:05.859578 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 126/261] 10.222.0.79 () {60 vars in 1323 bytes} [Wed Aug 31 12:32:05 2022] POST /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068/os-volume_attachments => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 12:32:05.866130 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-a34474fd-6b8c-47ff-8fc7-7dab3078bf23 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:32:05.867014 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-a34474fd-6b8c-47ff-8fc7-7dab3078bf23 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:05.875913 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a34474fd-6b8c-47ff-8fc7-7dab3078bf23 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:05.876421 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a34474fd-6b8c-47ff-8fc7-7dab3078bf23 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:05.876866 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a34474fd-6b8c-47ff-8fc7-7dab3078bf23 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:05.877603 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a34474fd-6b8c-47ff-8fc7-7dab3078bf23 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:05.878075 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a34474fd-6b8c-47ff-8fc7-7dab3078bf23 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:05.878506 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a34474fd-6b8c-47ff-8fc7-7dab3078bf23 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:05.974164 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-a34474fd-6b8c-47ff-8fc7-7dab3078bf23 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "POST /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068/action" status: 202 len: 0 microversion: 2.1 time: 0.112787 Aug 31 12:32:05.975629 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 136/262] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Aug 31 12:32:05 2022] POST /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 12:32:05.988772 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-93b83fc8-247e-46c8-abed-06edbcecdc4f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:05.990427 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-93b83fc8-247e-46c8-abed-06edbcecdc4f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:06.003142 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-93b83fc8-247e-46c8-abed-06edbcecdc4f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:06.004834 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-93b83fc8-247e-46c8-abed-06edbcecdc4f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:06.006005 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-93b83fc8-247e-46c8-abed-06edbcecdc4f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:06.007618 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-93b83fc8-247e-46c8-abed-06edbcecdc4f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:06.008570 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-93b83fc8-247e-46c8-abed-06edbcecdc4f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:06.009939 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-93b83fc8-247e-46c8-abed-06edbcecdc4f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:06.425726 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-93b83fc8-247e-46c8-abed-06edbcecdc4f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:06.436444 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-93b83fc8-247e-46c8-abed-06edbcecdc4f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1509 microversion: 2.1 time: 0.455153 Aug 31 12:32:06.437034 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 127/263] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:05 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1509 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:06.577796 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-5386afe2-c0fb-4a74-9b6b-3ec960bc7fc3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:06.579040 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-5386afe2-c0fb-4a74-9b6b-3ec960bc7fc3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:06.593013 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5386afe2-c0fb-4a74-9b6b-3ec960bc7fc3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:06.593907 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5386afe2-c0fb-4a74-9b6b-3ec960bc7fc3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:06.594702 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5386afe2-c0fb-4a74-9b6b-3ec960bc7fc3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:06.595945 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5386afe2-c0fb-4a74-9b6b-3ec960bc7fc3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:06.596792 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5386afe2-c0fb-4a74-9b6b-3ec960bc7fc3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:06.597703 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5386afe2-c0fb-4a74-9b6b-3ec960bc7fc3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:06.772960 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-058c97a9-3cd4-408e-819e-1238ae08e12b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:06.774072 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-058c97a9-3cd4-408e-819e-1238ae08e12b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:06.788609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-058c97a9-3cd4-408e-819e-1238ae08e12b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:06.789657 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-058c97a9-3cd4-408e-819e-1238ae08e12b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:06.790732 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-058c97a9-3cd4-408e-819e-1238ae08e12b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:06.792635 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-058c97a9-3cd4-408e-819e-1238ae08e12b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:06.794182 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-058c97a9-3cd4-408e-819e-1238ae08e12b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:06.795296 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-058c97a9-3cd4-408e-819e-1238ae08e12b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:06.828672 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-5386afe2-c0fb-4a74-9b6b-3ec960bc7fc3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:06.844755 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-5386afe2-c0fb-4a74-9b6b-3ec960bc7fc3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:06.848301 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-5386afe2-c0fb-4a74-9b6b-3ec960bc7fc3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:06.850905 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-5386afe2-c0fb-4a74-9b6b-3ec960bc7fc3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1724 microversion: 2.20 time: 0.295343 Aug 31 12:32:06.852263 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 137/264] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:06 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1724 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:07.101715 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-058c97a9-3cd4-408e-819e-1238ae08e12b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:07.120528 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-058c97a9-3cd4-408e-819e-1238ae08e12b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1722 microversion: 2.1 time: 0.354516 Aug 31 12:32:07.121877 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 128/265] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:06 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1722 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:32:07.465311 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-b7151fb4-ecaf-4486-81d6-341ec7e23bb7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:07.466338 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-b7151fb4-ecaf-4486-81d6-341ec7e23bb7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:07.480735 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b7151fb4-ecaf-4486-81d6-341ec7e23bb7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:07.486037 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b7151fb4-ecaf-4486-81d6-341ec7e23bb7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:07.486037 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b7151fb4-ecaf-4486-81d6-341ec7e23bb7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:07.486037 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b7151fb4-ecaf-4486-81d6-341ec7e23bb7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:07.492186 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b7151fb4-ecaf-4486-81d6-341ec7e23bb7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:07.494170 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b7151fb4-ecaf-4486-81d6-341ec7e23bb7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:07.881780 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-b7151fb4-ecaf-4486-81d6-341ec7e23bb7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:07.886675 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-2765d579-04ab-4b6c-ba6b-0d900f92546f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:07.887398 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-2765d579-04ab-4b6c-ba6b-0d900f92546f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:07.896816 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-b7151fb4-ecaf-4486-81d6-341ec7e23bb7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1509 microversion: 2.1 time: 0.435911 Aug 31 12:32:07.897713 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 138/266] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:07 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1509 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:07.912318 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2765d579-04ab-4b6c-ba6b-0d900f92546f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:07.913481 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2765d579-04ab-4b6c-ba6b-0d900f92546f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:07.916022 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2765d579-04ab-4b6c-ba6b-0d900f92546f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:07.918829 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2765d579-04ab-4b6c-ba6b-0d900f92546f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:07.920988 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2765d579-04ab-4b6c-ba6b-0d900f92546f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:07.923050 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2765d579-04ab-4b6c-ba6b-0d900f92546f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:08.149737 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-f1f486b5-61bd-4fc9-ab4e-6a31cc77190b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:08.150438 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-f1f486b5-61bd-4fc9-ab4e-6a31cc77190b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:08.158628 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f1f486b5-61bd-4fc9-ab4e-6a31cc77190b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:08.159700 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f1f486b5-61bd-4fc9-ab4e-6a31cc77190b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:08.160407 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f1f486b5-61bd-4fc9-ab4e-6a31cc77190b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:08.161355 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f1f486b5-61bd-4fc9-ab4e-6a31cc77190b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:08.166271 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f1f486b5-61bd-4fc9-ab4e-6a31cc77190b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:08.167426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f1f486b5-61bd-4fc9-ab4e-6a31cc77190b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:08.216353 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:08.490022 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-f1f486b5-61bd-4fc9-ab4e-6a31cc77190b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:08.508443 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-f1f486b5-61bd-4fc9-ab4e-6a31cc77190b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1722 microversion: 2.1 time: 0.366776 Aug 31 12:32:08.515128 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 139/267] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:08 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1722 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:32:08.693421 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-2765d579-04ab-4b6c-ba6b-0d900f92546f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:08.718160 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-2765d579-04ab-4b6c-ba6b-0d900f92546f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:08.721451 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-2765d579-04ab-4b6c-ba6b-0d900f92546f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:08.724467 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-2765d579-04ab-4b6c-ba6b-0d900f92546f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1724 microversion: 2.20 time: 0.842085 Aug 31 12:32:08.731585 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 129/268] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:07 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1724 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:32:08.927292 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-70160ed7-24a1-43e8-8402-30e02dc763e8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:08.928330 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-70160ed7-24a1-43e8-8402-30e02dc763e8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:08.937891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-70160ed7-24a1-43e8-8402-30e02dc763e8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:08.938633 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-70160ed7-24a1-43e8-8402-30e02dc763e8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:08.939606 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-70160ed7-24a1-43e8-8402-30e02dc763e8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:08.940443 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-70160ed7-24a1-43e8-8402-30e02dc763e8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:08.941171 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-70160ed7-24a1-43e8-8402-30e02dc763e8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:08.941711 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-70160ed7-24a1-43e8-8402-30e02dc763e8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:09.326367 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-70160ed7-24a1-43e8-8402-30e02dc763e8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:09.368504 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-70160ed7-24a1-43e8-8402-30e02dc763e8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1509 microversion: 2.1 time: 0.445056 Aug 31 12:32:09.383768 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 140/269] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:08 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1509 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:09.539188 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-c4726562-8863-4a3c-b93d-966ceae37d2b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:09.539953 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-c4726562-8863-4a3c-b93d-966ceae37d2b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:09.555111 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c4726562-8863-4a3c-b93d-966ceae37d2b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:09.555995 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c4726562-8863-4a3c-b93d-966ceae37d2b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:09.556614 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c4726562-8863-4a3c-b93d-966ceae37d2b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:09.561088 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c4726562-8863-4a3c-b93d-966ceae37d2b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:09.568803 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c4726562-8863-4a3c-b93d-966ceae37d2b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:09.569555 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c4726562-8863-4a3c-b93d-966ceae37d2b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:09.804400 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-8c386542-4ae2-4912-8752-d1a83982d12c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:09.806910 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-8c386542-4ae2-4912-8752-d1a83982d12c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:09.822405 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8c386542-4ae2-4912-8752-d1a83982d12c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:09.824761 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8c386542-4ae2-4912-8752-d1a83982d12c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:09.826020 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8c386542-4ae2-4912-8752-d1a83982d12c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:09.827735 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8c386542-4ae2-4912-8752-d1a83982d12c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:09.828867 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8c386542-4ae2-4912-8752-d1a83982d12c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:09.829892 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8c386542-4ae2-4912-8752-d1a83982d12c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:10.144164 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8c386542-4ae2-4912-8752-d1a83982d12c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:10.164480 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8c386542-4ae2-4912-8752-d1a83982d12c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:10.169188 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8c386542-4ae2-4912-8752-d1a83982d12c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:10.172203 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-8c386542-4ae2-4912-8752-d1a83982d12c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1745 microversion: 2.20 time: 0.396985 Aug 31 12:32:10.174905 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 141/270] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:09 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1745 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:10.280756 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-c4726562-8863-4a3c-b93d-966ceae37d2b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:10.295531 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-c4726562-8863-4a3c-b93d-966ceae37d2b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1722 microversion: 2.1 time: 0.760206 Aug 31 12:32:10.298874 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 130/271] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:09 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1722 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:10.399765 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-3020d48b-6711-4087-9491-8f28ed99571e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:10.409508 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-3020d48b-6711-4087-9491-8f28ed99571e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:10.438429 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3020d48b-6711-4087-9491-8f28ed99571e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:10.439258 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3020d48b-6711-4087-9491-8f28ed99571e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:10.439883 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3020d48b-6711-4087-9491-8f28ed99571e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:10.441438 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3020d48b-6711-4087-9491-8f28ed99571e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:10.442111 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3020d48b-6711-4087-9491-8f28ed99571e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:10.443066 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3020d48b-6711-4087-9491-8f28ed99571e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:10.756465 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-3020d48b-6711-4087-9491-8f28ed99571e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:10.770501 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-3020d48b-6711-4087-9491-8f28ed99571e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1509 microversion: 2.1 time: 0.381313 Aug 31 12:32:10.772079 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 142/272] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:10 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1509 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:11.204214 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-1e6cf496-6b44-4990-a135-2d172821aa09 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:11.205301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-1e6cf496-6b44-4990-a135-2d172821aa09 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:11.214577 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1e6cf496-6b44-4990-a135-2d172821aa09 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:11.215106 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1e6cf496-6b44-4990-a135-2d172821aa09 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:11.215680 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1e6cf496-6b44-4990-a135-2d172821aa09 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:11.216486 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1e6cf496-6b44-4990-a135-2d172821aa09 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:11.217173 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1e6cf496-6b44-4990-a135-2d172821aa09 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:11.217620 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1e6cf496-6b44-4990-a135-2d172821aa09 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:11.332809 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-8505bdca-221a-4b91-a145-9b777a1e9dd8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:11.333419 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-8505bdca-221a-4b91-a145-9b777a1e9dd8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:11.348374 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8505bdca-221a-4b91-a145-9b777a1e9dd8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:11.348869 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8505bdca-221a-4b91-a145-9b777a1e9dd8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:11.349336 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8505bdca-221a-4b91-a145-9b777a1e9dd8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:11.350419 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8505bdca-221a-4b91-a145-9b777a1e9dd8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:11.352665 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8505bdca-221a-4b91-a145-9b777a1e9dd8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:11.353106 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8505bdca-221a-4b91-a145-9b777a1e9dd8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:11.721911 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-1e6cf496-6b44-4990-a135-2d172821aa09 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:11.742648 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-1e6cf496-6b44-4990-a135-2d172821aa09 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:11.758605 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-1e6cf496-6b44-4990-a135-2d172821aa09 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:11.762548 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-1e6cf496-6b44-4990-a135-2d172821aa09 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1745 microversion: 2.20 time: 0.564365 Aug 31 12:32:11.769505 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 131/273] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:11 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1745 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:11.797638 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-51b0c2ce-244b-4fa8-ac26-fbefd89227c4 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:11.799140 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-51b0c2ce-244b-4fa8-ac26-fbefd89227c4 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:11.822451 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-51b0c2ce-244b-4fa8-ac26-fbefd89227c4 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:11.826434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-51b0c2ce-244b-4fa8-ac26-fbefd89227c4 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:11.827494 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-51b0c2ce-244b-4fa8-ac26-fbefd89227c4 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:11.828649 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-51b0c2ce-244b-4fa8-ac26-fbefd89227c4 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:11.830728 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-51b0c2ce-244b-4fa8-ac26-fbefd89227c4 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:11.835875 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-51b0c2ce-244b-4fa8-ac26-fbefd89227c4 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:12.498585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8505bdca-221a-4b91-a145-9b777a1e9dd8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:12.509343 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-51b0c2ce-244b-4fa8-ac26-fbefd89227c4 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:12.547698 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-51b0c2ce-244b-4fa8-ac26-fbefd89227c4 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1509 microversion: 2.1 time: 0.754440 Aug 31 12:32:12.551250 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 132/274] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:11 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1509 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:32:12.566727 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-8505bdca-221a-4b91-a145-9b777a1e9dd8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1722 microversion: 2.1 time: 1.242640 Aug 31 12:32:12.580971 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 143/275] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:11 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1722 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:32:12.582244 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-3ac25c06-dc80-4ef4-8ab6-ddb8eaec590a req-632e7b79-84e6-4876-9abc-0b8209291a8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34ecec01-dd25-474d-addd-1d9b8de152b8", "name": "network-vif-plugged", "status": "completed", "tag": "da6f3218-a171-4509-bd68-c737a3ff6eaf"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:32:12.637485 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-3ac25c06-dc80-4ef4-8ab6-ddb8eaec590a req-632e7b79-84e6-4876-9abc-0b8209291a8f service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:12.638315 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-3ac25c06-dc80-4ef4-8ab6-ddb8eaec590a req-632e7b79-84e6-4876-9abc-0b8209291a8f service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:12.639063 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-3ac25c06-dc80-4ef4-8ab6-ddb8eaec590a req-632e7b79-84e6-4876-9abc-0b8209291a8f service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:12.672276 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-3ac25c06-dc80-4ef4-8ab6-ddb8eaec590a req-632e7b79-84e6-4876-9abc-0b8209291a8f service nova] Creating event network-vif-plugged:da6f3218-a171-4509-bd68-c737a3ff6eaf for instance 34ecec01-dd25-474d-addd-1d9b8de152b8 on hv-cinder-85528 Aug 31 12:32:12.704270 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-3ac25c06-dc80-4ef4-8ab6-ddb8eaec590a req-632e7b79-84e6-4876-9abc-0b8209291a8f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148659 Aug 31 12:32:12.704270 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 133/276] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:32:12.811422 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-8667dfe9-d38e-462a-8f34-211ac7a30d0a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:12.812800 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-8667dfe9-d38e-462a-8f34-211ac7a30d0a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:12.843819 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8667dfe9-d38e-462a-8f34-211ac7a30d0a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:12.844411 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8667dfe9-d38e-462a-8f34-211ac7a30d0a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:12.844786 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8667dfe9-d38e-462a-8f34-211ac7a30d0a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:12.845498 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8667dfe9-d38e-462a-8f34-211ac7a30d0a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:12.845959 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8667dfe9-d38e-462a-8f34-211ac7a30d0a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:12.846382 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8667dfe9-d38e-462a-8f34-211ac7a30d0a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:13.123309 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8667dfe9-d38e-462a-8f34-211ac7a30d0a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:13.168279 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8667dfe9-d38e-462a-8f34-211ac7a30d0a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:13.173880 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8667dfe9-d38e-462a-8f34-211ac7a30d0a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:13.176711 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-8667dfe9-d38e-462a-8f34-211ac7a30d0a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1740 microversion: 2.20 time: 0.373529 Aug 31 12:32:13.181764 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 144/277] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:12 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1740 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:13.596858 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-f554f45b-cd64-436f-aff8-6d5d625c413f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:13.598288 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-697549cf-974a-4a38-94ff-edaffa003459 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:13.599167 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-697549cf-974a-4a38-94ff-edaffa003459 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:13.599781 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-f554f45b-cd64-436f-aff8-6d5d625c413f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:13.619101 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-697549cf-974a-4a38-94ff-edaffa003459 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:13.624407 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-697549cf-974a-4a38-94ff-edaffa003459 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:13.630318 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-697549cf-974a-4a38-94ff-edaffa003459 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:13.632989 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f554f45b-cd64-436f-aff8-6d5d625c413f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:13.633512 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f554f45b-cd64-436f-aff8-6d5d625c413f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:13.635025 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-697549cf-974a-4a38-94ff-edaffa003459 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:13.635676 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-697549cf-974a-4a38-94ff-edaffa003459 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:13.636101 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-697549cf-974a-4a38-94ff-edaffa003459 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:13.638270 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f554f45b-cd64-436f-aff8-6d5d625c413f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:13.639752 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f554f45b-cd64-436f-aff8-6d5d625c413f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:13.641426 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f554f45b-cd64-436f-aff8-6d5d625c413f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:13.642936 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f554f45b-cd64-436f-aff8-6d5d625c413f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:14.155522 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f554f45b-cd64-436f-aff8-6d5d625c413f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:14.207723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-f554f45b-cd64-436f-aff8-6d5d625c413f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1515 microversion: 2.1 time: 0.587966 Aug 31 12:32:14.223445 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 134/278] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:13 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1515 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:14.267447 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-f1914f7b-c164-47fb-8a7b-102b5bf1a0cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:14.271461 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-f1914f7b-c164-47fb-8a7b-102b5bf1a0cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:14.312235 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f1914f7b-c164-47fb-8a7b-102b5bf1a0cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:14.318332 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f1914f7b-c164-47fb-8a7b-102b5bf1a0cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:14.319744 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f1914f7b-c164-47fb-8a7b-102b5bf1a0cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:14.328145 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f1914f7b-c164-47fb-8a7b-102b5bf1a0cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:14.330560 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f1914f7b-c164-47fb-8a7b-102b5bf1a0cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:14.331105 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f1914f7b-c164-47fb-8a7b-102b5bf1a0cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:14.432599 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=100 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:14.468004 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-697549cf-974a-4a38-94ff-edaffa003459 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:14.488094 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-697549cf-974a-4a38-94ff-edaffa003459 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1722 microversion: 2.1 time: 0.893543 Aug 31 12:32:14.507992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 145/279] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:13 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1722 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:14.812575 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f1914f7b-c164-47fb-8a7b-102b5bf1a0cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:14.849000 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f1914f7b-c164-47fb-8a7b-102b5bf1a0cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:14.852515 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f1914f7b-c164-47fb-8a7b-102b5bf1a0cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:14.857104 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-f1914f7b-c164-47fb-8a7b-102b5bf1a0cb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1740 microversion: 2.20 time: 0.632473 Aug 31 12:32:14.865712 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 135/280] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:14 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1740 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:15.524692 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-d77e8b0b-38d7-4bed-a2b2-e6b006def098 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:15.525540 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-d77e8b0b-38d7-4bed-a2b2-e6b006def098 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:15.559416 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d77e8b0b-38d7-4bed-a2b2-e6b006def098 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:15.559903 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d77e8b0b-38d7-4bed-a2b2-e6b006def098 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:15.560389 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d77e8b0b-38d7-4bed-a2b2-e6b006def098 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:15.561091 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d77e8b0b-38d7-4bed-a2b2-e6b006def098 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:15.569777 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d77e8b0b-38d7-4bed-a2b2-e6b006def098 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:15.578290 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d77e8b0b-38d7-4bed-a2b2-e6b006def098 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:15.899930 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-3e22c640-6c1f-4a3a-9568-a63315912efe tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:15.901251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-3e22c640-6c1f-4a3a-9568-a63315912efe tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:15.913288 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3e22c640-6c1f-4a3a-9568-a63315912efe tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:15.914442 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3e22c640-6c1f-4a3a-9568-a63315912efe tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:15.915127 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3e22c640-6c1f-4a3a-9568-a63315912efe tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:15.916092 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3e22c640-6c1f-4a3a-9568-a63315912efe tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:15.917475 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3e22c640-6c1f-4a3a-9568-a63315912efe tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:15.918355 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3e22c640-6c1f-4a3a-9568-a63315912efe tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:16.020012 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-d77e8b0b-38d7-4bed-a2b2-e6b006def098 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:16.031554 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-d77e8b0b-38d7-4bed-a2b2-e6b006def098 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1722 microversion: 2.1 time: 0.511098 Aug 31 12:32:16.038606 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 146/281] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:15 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1722 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:16.259976 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-3e22c640-6c1f-4a3a-9568-a63315912efe tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:16.277255 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-3e22c640-6c1f-4a3a-9568-a63315912efe tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:16.278763 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-3e22c640-6c1f-4a3a-9568-a63315912efe tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:16.287958 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-3e22c640-6c1f-4a3a-9568-a63315912efe tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1740 microversion: 2.20 time: 0.396983 Aug 31 12:32:16.288573 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 136/282] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:15 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1740 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:32:17.078798 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-41f5cc1a-ea29-4aa8-b23b-85b70ef41b9c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:17.079808 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-41f5cc1a-ea29-4aa8-b23b-85b70ef41b9c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:17.098831 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-41f5cc1a-ea29-4aa8-b23b-85b70ef41b9c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:17.099944 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-41f5cc1a-ea29-4aa8-b23b-85b70ef41b9c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:17.100592 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-41f5cc1a-ea29-4aa8-b23b-85b70ef41b9c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:17.101439 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-41f5cc1a-ea29-4aa8-b23b-85b70ef41b9c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:17.101915 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-41f5cc1a-ea29-4aa8-b23b-85b70ef41b9c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:17.102347 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-41f5cc1a-ea29-4aa8-b23b-85b70ef41b9c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:17.328262 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-445365c5-6fe7-4e79-808e-9b67d31b36a6 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:17.341687 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-445365c5-6fe7-4e79-808e-9b67d31b36a6 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:17.375627 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-445365c5-6fe7-4e79-808e-9b67d31b36a6 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:17.376532 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-445365c5-6fe7-4e79-808e-9b67d31b36a6 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:17.379932 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-445365c5-6fe7-4e79-808e-9b67d31b36a6 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:17.384258 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-445365c5-6fe7-4e79-808e-9b67d31b36a6 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:17.390609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-445365c5-6fe7-4e79-808e-9b67d31b36a6 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:17.391809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-445365c5-6fe7-4e79-808e-9b67d31b36a6 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:17.715775 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-41f5cc1a-ea29-4aa8-b23b-85b70ef41b9c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:17.751404 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-41f5cc1a-ea29-4aa8-b23b-85b70ef41b9c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1722 microversion: 2.1 time: 0.678226 Aug 31 12:32:17.773335 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 147/283] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:17 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1722 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:18.157298 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-445365c5-6fe7-4e79-808e-9b67d31b36a6 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:18.173717 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-445365c5-6fe7-4e79-808e-9b67d31b36a6 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:18.178765 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-445365c5-6fe7-4e79-808e-9b67d31b36a6 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:18.184344 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-445365c5-6fe7-4e79-808e-9b67d31b36a6 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1740 microversion: 2.20 time: 0.870207 Aug 31 12:32:18.184953 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 137/284] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:17 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1740 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:18.785425 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-8fa5b15d-ee00-4da8-ad1c-5566e6bdb149 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:18.786450 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-8fa5b15d-ee00-4da8-ad1c-5566e6bdb149 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:18.806328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8fa5b15d-ee00-4da8-ad1c-5566e6bdb149 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:18.807313 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8fa5b15d-ee00-4da8-ad1c-5566e6bdb149 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:18.818201 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8fa5b15d-ee00-4da8-ad1c-5566e6bdb149 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:18.819470 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8fa5b15d-ee00-4da8-ad1c-5566e6bdb149 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:18.820146 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8fa5b15d-ee00-4da8-ad1c-5566e6bdb149 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:18.820743 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8fa5b15d-ee00-4da8-ad1c-5566e6bdb149 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:18.853950 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-dd0e8a4d-a323-43a5-9949-260f85baf377 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Action: 'create', calling method: .version_select at 0x7f8d17422430>, body: {"keypair": {"name": "tempest-keypair-1257648095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhMeLzrcuT+SpzMHGRhkiSEH7c0oNJirqGnzD/3/ip9dbAPFujYp/YCPsYcyVJQypd8ScwkmWEmuFVPWKB3UcpFGaK2kHfbs3ozKt4kpKzR5dGOHUrw1lnisjv2MAbfQg=="}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:32:18.913623 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-dd0e8a4d-a323-43a5-9949-260f85baf377 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Getting quotas for project 7327d2f6422e4bdb9e250e44987dace3. Resources: {'key_pairs'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:32:18.921856 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-dd0e8a4d-a323-43a5-9949-260f85baf377 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Getting quotas for user 64886d73c79649d1a824170a33f53fcb and project 7327d2f6422e4bdb9e250e44987dace3. Resources: {'key_pairs'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:32:19.000339 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-dd0e8a4d-a323-43a5-9949-260f85baf377 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.150720 Aug 31 12:32:19.001288 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 138/285] 10.222.0.79 () {60 vars in 1159 bytes} [Wed Aug 31 12:32:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:32:19.236901 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-1784e13f-7af5-4602-b357-932971b73794 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:19.245594 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8fa5b15d-ee00-4da8-ad1c-5566e6bdb149 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:19.248941 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-1784e13f-7af5-4602-b357-932971b73794 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:19.286373 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-8fa5b15d-ee00-4da8-ad1c-5566e6bdb149 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1722 microversion: 2.1 time: 0.502492 Aug 31 12:32:19.297953 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 148/286] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:18 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1722 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:19.312693 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1784e13f-7af5-4602-b357-932971b73794 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:19.313288 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1784e13f-7af5-4602-b357-932971b73794 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:19.313740 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1784e13f-7af5-4602-b357-932971b73794 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:19.314496 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1784e13f-7af5-4602-b357-932971b73794 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:19.319097 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1784e13f-7af5-4602-b357-932971b73794 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:19.319643 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1784e13f-7af5-4602-b357-932971b73794 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:19.835758 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-1784e13f-7af5-4602-b357-932971b73794 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:19.868167 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-1784e13f-7af5-4602-b357-932971b73794 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:19.871840 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-1784e13f-7af5-4602-b357-932971b73794 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:19.873289 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-1784e13f-7af5-4602-b357-932971b73794 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1740 microversion: 2.20 time: 0.667123 Aug 31 12:32:19.888201 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 139/287] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:19 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1740 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:20.335440 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-bac08184-ed70-427f-b34b-2d91defdedb6 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:20.340896 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-bac08184-ed70-427f-b34b-2d91defdedb6 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:20.364128 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bac08184-ed70-427f-b34b-2d91defdedb6 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:20.369515 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bac08184-ed70-427f-b34b-2d91defdedb6 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:20.372787 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bac08184-ed70-427f-b34b-2d91defdedb6 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:20.380463 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bac08184-ed70-427f-b34b-2d91defdedb6 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:20.380959 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bac08184-ed70-427f-b34b-2d91defdedb6 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:20.381803 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bac08184-ed70-427f-b34b-2d91defdedb6 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:20.685556 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-bac08184-ed70-427f-b34b-2d91defdedb6 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:20.758803 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-bac08184-ed70-427f-b34b-2d91defdedb6 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1722 microversion: 2.1 time: 0.417914 Aug 31 12:32:20.760269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 149/288] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:20 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1722 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:32:20.907092 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-d5fd7ed9-748d-4137-9439-7205a69ebfbb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:20.908219 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-d5fd7ed9-748d-4137-9439-7205a69ebfbb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:20.936479 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d5fd7ed9-748d-4137-9439-7205a69ebfbb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:20.943714 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d5fd7ed9-748d-4137-9439-7205a69ebfbb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:20.947566 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d5fd7ed9-748d-4137-9439-7205a69ebfbb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:20.949504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d5fd7ed9-748d-4137-9439-7205a69ebfbb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:20.950379 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d5fd7ed9-748d-4137-9439-7205a69ebfbb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:20.951202 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d5fd7ed9-748d-4137-9439-7205a69ebfbb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:21.627175 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-d5fd7ed9-748d-4137-9439-7205a69ebfbb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:21.647805 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-d5fd7ed9-748d-4137-9439-7205a69ebfbb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:21.657295 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-d5fd7ed9-748d-4137-9439-7205a69ebfbb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:21.688802 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-d5fd7ed9-748d-4137-9439-7205a69ebfbb tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1740 microversion: 2.20 time: 0.788813 Aug 31 12:32:21.691674 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 140/289] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:20 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1740 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:21.797516 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-a5af4221-98ab-4713-8519-d3e3b4d173e8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:21.798387 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-a5af4221-98ab-4713-8519-d3e3b4d173e8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:21.851833 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a5af4221-98ab-4713-8519-d3e3b4d173e8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:21.882881 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a5af4221-98ab-4713-8519-d3e3b4d173e8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:21.888667 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a5af4221-98ab-4713-8519-d3e3b4d173e8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:21.891733 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a5af4221-98ab-4713-8519-d3e3b4d173e8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:21.895423 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a5af4221-98ab-4713-8519-d3e3b4d173e8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:21.895961 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a5af4221-98ab-4713-8519-d3e3b4d173e8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:22.251075 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-a5af4221-98ab-4713-8519-d3e3b4d173e8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:22.286755 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-a5af4221-98ab-4713-8519-d3e3b4d173e8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1722 microversion: 2.1 time: 0.497375 Aug 31 12:32:22.300743 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 150/290] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:21 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1722 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:22.736170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-06703280-d8d1-4554-bf40-ddba16e57826 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:22.736792 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-06703280-d8d1-4554-bf40-ddba16e57826 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:22.747652 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-06703280-d8d1-4554-bf40-ddba16e57826 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:22.748149 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-06703280-d8d1-4554-bf40-ddba16e57826 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:22.751602 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-06703280-d8d1-4554-bf40-ddba16e57826 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:22.753395 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-06703280-d8d1-4554-bf40-ddba16e57826 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:22.757208 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-06703280-d8d1-4554-bf40-ddba16e57826 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:22.758141 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-06703280-d8d1-4554-bf40-ddba16e57826 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:23.325505 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-2c23a042-3efc-45ab-8d3f-43135557ed75 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:23.326129 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-2c23a042-3efc-45ab-8d3f-43135557ed75 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:23.346419 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2c23a042-3efc-45ab-8d3f-43135557ed75 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:23.351190 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2c23a042-3efc-45ab-8d3f-43135557ed75 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:23.351766 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2c23a042-3efc-45ab-8d3f-43135557ed75 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:23.354216 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2c23a042-3efc-45ab-8d3f-43135557ed75 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:23.360467 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2c23a042-3efc-45ab-8d3f-43135557ed75 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:23.361734 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2c23a042-3efc-45ab-8d3f-43135557ed75 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:23.589629 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-06703280-d8d1-4554-bf40-ddba16e57826 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:23.614419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-06703280-d8d1-4554-bf40-ddba16e57826 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:23.619504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-06703280-d8d1-4554-bf40-ddba16e57826 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:23.622071 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-06703280-d8d1-4554-bf40-ddba16e57826 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1740 microversion: 2.20 time: 0.892016 Aug 31 12:32:23.626021 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 141/291] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:22 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1740 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:23.759541 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-2c23a042-3efc-45ab-8d3f-43135557ed75 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:23.770480 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-2c23a042-3efc-45ab-8d3f-43135557ed75 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1722 microversion: 2.1 time: 0.450799 Aug 31 12:32:23.786637 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 151/292] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:23 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1722 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:24.655336 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-3deadaec-0ee8-4f04-9286-96b224135b41 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:24.656116 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-3deadaec-0ee8-4f04-9286-96b224135b41 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:24.680023 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3deadaec-0ee8-4f04-9286-96b224135b41 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:24.684240 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3deadaec-0ee8-4f04-9286-96b224135b41 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:24.684946 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3deadaec-0ee8-4f04-9286-96b224135b41 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:24.686535 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3deadaec-0ee8-4f04-9286-96b224135b41 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:24.687270 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3deadaec-0ee8-4f04-9286-96b224135b41 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:24.688236 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3deadaec-0ee8-4f04-9286-96b224135b41 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:24.988515 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-d7bd87f2-be6d-458b-b1ff-e73ee7c70710 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Action: 'create', calling method: .version_select at 0x7f8d17422b80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-280733761", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGHrHr8tXIIf/GJvua/qH8NwKrV3tIFpDLbKsLw0/fTBHYDFmeEqr3P+WXT4xO7oONIl2MoGc/yZ+HvdGIJITrOepeAQD9uLkK/doFrpipoovd9uICHejt5/gQYMtY7KQ=="}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:32:25.000758 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:25.012515 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-3deadaec-0ee8-4f04-9286-96b224135b41 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:25.019843 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-3deadaec-0ee8-4f04-9286-96b224135b41 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:25.022560 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-3deadaec-0ee8-4f04-9286-96b224135b41 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:25.023828 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-3deadaec-0ee8-4f04-9286-96b224135b41 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1740 microversion: 2.20 time: 0.373826 Aug 31 12:32:25.024405 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 152/293] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:24 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1740 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:32:25.031800 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-d7bd87f2-be6d-458b-b1ff-e73ee7c70710 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Getting quotas for project b364169c30154cc8af7c9a37bebc8040. Resources: {'key_pairs'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:32:25.036493 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-d7bd87f2-be6d-458b-b1ff-e73ee7c70710 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Getting quotas for user 2e77671c123f434489d82da79212d0ab and project b364169c30154cc8af7c9a37bebc8040. Resources: {'key_pairs'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:32:25.076021 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-d7bd87f2-be6d-458b-b1ff-e73ee7c70710 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.545148 Aug 31 12:32:25.079005 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 142/294] 10.222.0.79 () {60 vars in 1159 bytes} [Wed Aug 31 12:32:24 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:32:25.081480 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-bf207a37-0e0b-40f7-806a-8aa41808ca9b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-749475926", "imageRef": "2aaf4ebd-395b-468e-bb6b-c663d01edea0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fcfceaa8-05fa-4d60-80d3-79a71d2a7781"}], "security_groups": [{"name": "tempest-securitygroup--1782733036"}], "key_name": "tempest-keypair-1257648095", "user_data": "}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:32:25.087493 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-a008c6c2-70be-4953-b52d-e02b26003b63 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:25.089765 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-a008c6c2-70be-4953-b52d-e02b26003b63 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:25.106042 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a008c6c2-70be-4953-b52d-e02b26003b63 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:25.107442 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a008c6c2-70be-4953-b52d-e02b26003b63 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:25.108433 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a008c6c2-70be-4953-b52d-e02b26003b63 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:25.110794 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a008c6c2-70be-4953-b52d-e02b26003b63 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:25.114304 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a008c6c2-70be-4953-b52d-e02b26003b63 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:25.115027 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a008c6c2-70be-4953-b52d-e02b26003b63 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:25.272811 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.network.neutron [None req-bf207a37-0e0b-40f7-806a-8aa41808ca9b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] validate_networks() for [('fcfceaa8-05fa-4d60-80d3-79a71d2a7781', None, None, None, None, None)] {{(pid=120749) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:32:25.673709 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-a008c6c2-70be-4953-b52d-e02b26003b63 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:25.690696 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-a008c6c2-70be-4953-b52d-e02b26003b63 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1722 microversion: 2.1 time: 0.610284 Aug 31 12:32:25.693469 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 143/295] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:25 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1722 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:26.064004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-4e99ca20-9cbf-4fe1-801b-cc4666f66c1b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:26.065528 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-4e99ca20-9cbf-4fe1-801b-cc4666f66c1b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:26.083781 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4e99ca20-9cbf-4fe1-801b-cc4666f66c1b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:26.085006 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4e99ca20-9cbf-4fe1-801b-cc4666f66c1b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:26.086624 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4e99ca20-9cbf-4fe1-801b-cc4666f66c1b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:26.088223 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4e99ca20-9cbf-4fe1-801b-cc4666f66c1b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:26.089648 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4e99ca20-9cbf-4fe1-801b-cc4666f66c1b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:26.090486 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4e99ca20-9cbf-4fe1-801b-cc4666f66c1b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:26.282519 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-bf207a37-0e0b-40f7-806a-8aa41808ca9b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Flavor limits 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:32:26.283091 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-bf207a37-0e0b-40f7-806a-8aa41808ca9b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Image limits 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:32:26.284143 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-bf207a37-0e0b-40f7-806a-8aa41808ca9b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Flavor pref 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:32:26.284566 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-bf207a37-0e0b-40f7-806a-8aa41808ca9b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Image pref 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:32:26.285475 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-bf207a37-0e0b-40f7-806a-8aa41808ca9b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:32:26.306686 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bf207a37-0e0b-40f7-806a-8aa41808ca9b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:26.308900 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bf207a37-0e0b-40f7-806a-8aa41808ca9b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:26.314286 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bf207a37-0e0b-40f7-806a-8aa41808ca9b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:26.315453 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bf207a37-0e0b-40f7-806a-8aa41808ca9b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:26.316192 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bf207a37-0e0b-40f7-806a-8aa41808ca9b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:26.316826 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bf207a37-0e0b-40f7-806a-8aa41808ca9b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:26.327891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-4e99ca20-9cbf-4fe1-801b-cc4666f66c1b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:26.344709 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-4e99ca20-9cbf-4fe1-801b-cc4666f66c1b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:26.352089 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-4e99ca20-9cbf-4fe1-801b-cc4666f66c1b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:26.354328 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-4e99ca20-9cbf-4fe1-801b-cc4666f66c1b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1740 microversion: 2.20 time: 0.295365 Aug 31 12:32:26.355620 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 144/296] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:26 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1740 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:26.384798 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-bf207a37-0e0b-40f7-806a-8aa41808ca9b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Getting quotas for project 7327d2f6422e4bdb9e250e44987dace3. Resources: {'cores', 'ram', 'instances'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:32:26.398064 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-bf207a37-0e0b-40f7-806a-8aa41808ca9b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Getting quotas for user 64886d73c79649d1a824170a33f53fcb and project 7327d2f6422e4bdb9e250e44987dace3. Resources: {'cores', 'ram', 'instances'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:32:26.426295 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-bf207a37-0e0b-40f7-806a-8aa41808ca9b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Going to run 1 instances... {{(pid=120749) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:32:26.429320 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-bf207a37-0e0b-40f7-806a-8aa41808ca9b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aaf4ebd-395b-468e-bb6b-c663d01edea0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:32:26.527551 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-bf207a37-0e0b-40f7-806a-8aa41808ca9b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.471952 Aug 31 12:32:26.528536 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 153/297] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 31 12:32:25 2022] POST /compute/v2.1/servers => generated 409 bytes in 1504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:32:26.560581 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-9f2c2bc7-8208-4345-827e-913bf110f2bd tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:26.561366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-9f2c2bc7-8208-4345-827e-913bf110f2bd tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:26.686290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-9f2c2bc7-8208-4345-827e-913bf110f2bd tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:26.697084 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-9f2c2bc7-8208-4345-827e-913bf110f2bd tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1245 microversion: 2.1 time: 0.158413 Aug 31 12:32:26.700420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 145/298] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:26 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1245 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:26.720257 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-2f492721-b620-4a93-a9c4-7a1694410bc5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:26.737126 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-2f492721-b620-4a93-a9c4-7a1694410bc5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:26.748195 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2f492721-b620-4a93-a9c4-7a1694410bc5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:26.750221 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2f492721-b620-4a93-a9c4-7a1694410bc5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:26.750800 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2f492721-b620-4a93-a9c4-7a1694410bc5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:26.754597 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2f492721-b620-4a93-a9c4-7a1694410bc5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:26.755653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2f492721-b620-4a93-a9c4-7a1694410bc5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:26.756095 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2f492721-b620-4a93-a9c4-7a1694410bc5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:27.036990 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-2f492721-b620-4a93-a9c4-7a1694410bc5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:27.055835 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-2f492721-b620-4a93-a9c4-7a1694410bc5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1722 microversion: 2.1 time: 0.342930 Aug 31 12:32:27.074592 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 154/299] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:26 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1722 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:27.388624 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-6cd984bd-8232-47f7-b778-6620644d2d66 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:27.389472 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-6cd984bd-8232-47f7-b778-6620644d2d66 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:27.404656 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6cd984bd-8232-47f7-b778-6620644d2d66 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:27.405159 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6cd984bd-8232-47f7-b778-6620644d2d66 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:27.405667 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6cd984bd-8232-47f7-b778-6620644d2d66 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:27.406390 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6cd984bd-8232-47f7-b778-6620644d2d66 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:27.406885 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6cd984bd-8232-47f7-b778-6620644d2d66 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:27.407307 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6cd984bd-8232-47f7-b778-6620644d2d66 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:27.727783 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-b7831880-b7d5-4c4d-8f83-b26e85e11a8b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:27.729544 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-b7831880-b7d5-4c4d-8f83-b26e85e11a8b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:27.747061 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b7831880-b7d5-4c4d-8f83-b26e85e11a8b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:27.748023 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b7831880-b7d5-4c4d-8f83-b26e85e11a8b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:27.749567 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b7831880-b7d5-4c4d-8f83-b26e85e11a8b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:27.752231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b7831880-b7d5-4c4d-8f83-b26e85e11a8b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:27.753684 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b7831880-b7d5-4c4d-8f83-b26e85e11a8b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:27.755017 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b7831880-b7d5-4c4d-8f83-b26e85e11a8b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:27.962387 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-6cd984bd-8232-47f7-b778-6620644d2d66 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:27.984860 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-b7831880-b7d5-4c4d-8f83-b26e85e11a8b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:28.014187 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-b7831880-b7d5-4c4d-8f83-b26e85e11a8b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1241 microversion: 2.1 time: 0.296049 Aug 31 12:32:28.035345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 155/300] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:27 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1241 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:28.048962 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-6cd984bd-8232-47f7-b778-6620644d2d66 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:28.060761 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-6cd984bd-8232-47f7-b778-6620644d2d66 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:28.064178 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-6cd984bd-8232-47f7-b778-6620644d2d66 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1740 microversion: 2.20 time: 0.681924 Aug 31 12:32:28.085955 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 146/301] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:27 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1740 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:28.090506 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-58b709d0-3be7-4f5b-a27c-c05cf73200fb tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:28.091655 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-58b709d0-3be7-4f5b-a27c-c05cf73200fb tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:28.110275 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-58b709d0-3be7-4f5b-a27c-c05cf73200fb tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:28.111337 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-58b709d0-3be7-4f5b-a27c-c05cf73200fb tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:28.112426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-58b709d0-3be7-4f5b-a27c-c05cf73200fb tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:28.113440 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-58b709d0-3be7-4f5b-a27c-c05cf73200fb tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:28.114277 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-58b709d0-3be7-4f5b-a27c-c05cf73200fb tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:28.115531 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-58b709d0-3be7-4f5b-a27c-c05cf73200fb tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:28.172971 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=100 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:28.498480 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-58b709d0-3be7-4f5b-a27c-c05cf73200fb tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:28.515066 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-58b709d0-3be7-4f5b-a27c-c05cf73200fb tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1722 microversion: 2.1 time: 0.434041 Aug 31 12:32:28.516494 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 156/302] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:28 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1722 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:29.046281 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-24db9ecd-9c78-41d2-b26c-f160cb1663e1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:29.047872 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-24db9ecd-9c78-41d2-b26c-f160cb1663e1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:29.062247 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-24db9ecd-9c78-41d2-b26c-f160cb1663e1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:29.063109 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-24db9ecd-9c78-41d2-b26c-f160cb1663e1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:29.065187 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-24db9ecd-9c78-41d2-b26c-f160cb1663e1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:29.067201 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-24db9ecd-9c78-41d2-b26c-f160cb1663e1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:29.069281 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-24db9ecd-9c78-41d2-b26c-f160cb1663e1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:29.072002 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-24db9ecd-9c78-41d2-b26c-f160cb1663e1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:29.094958 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-587b4c66-0445-415d-bcef-b03b801e3ab7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:29.096418 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-587b4c66-0445-415d-bcef-b03b801e3ab7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:29.098829 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:29.121770 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-587b4c66-0445-415d-bcef-b03b801e3ab7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:29.124010 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-587b4c66-0445-415d-bcef-b03b801e3ab7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:29.125516 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-587b4c66-0445-415d-bcef-b03b801e3ab7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:29.130301 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-587b4c66-0445-415d-bcef-b03b801e3ab7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:29.131861 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-587b4c66-0445-415d-bcef-b03b801e3ab7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:29.135140 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-587b4c66-0445-415d-bcef-b03b801e3ab7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:29.349957 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-24db9ecd-9c78-41d2-b26c-f160cb1663e1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:29.379803 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-24db9ecd-9c78-41d2-b26c-f160cb1663e1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1305 microversion: 2.1 time: 0.339003 Aug 31 12:32:29.380858 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 147/303] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:29 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1305 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:29.484651 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-587b4c66-0445-415d-bcef-b03b801e3ab7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:29.497926 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-587b4c66-0445-415d-bcef-b03b801e3ab7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:29.502285 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-587b4c66-0445-415d-bcef-b03b801e3ab7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:29.505077 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-587b4c66-0445-415d-bcef-b03b801e3ab7 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1740 microversion: 2.20 time: 0.415090 Aug 31 12:32:29.524213 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 157/304] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:29 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1740 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:29.543185 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-77b96dc1-0ce0-4d64-8f37-1ec163b39659 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:29.543799 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-77b96dc1-0ce0-4d64-8f37-1ec163b39659 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:29.574640 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-77b96dc1-0ce0-4d64-8f37-1ec163b39659 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:29.578776 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-77b96dc1-0ce0-4d64-8f37-1ec163b39659 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:29.579597 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-77b96dc1-0ce0-4d64-8f37-1ec163b39659 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:29.582694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-77b96dc1-0ce0-4d64-8f37-1ec163b39659 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:29.583314 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-77b96dc1-0ce0-4d64-8f37-1ec163b39659 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:29.584995 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-77b96dc1-0ce0-4d64-8f37-1ec163b39659 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:29.939131 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-77b96dc1-0ce0-4d64-8f37-1ec163b39659 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:29.965931 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-77b96dc1-0ce0-4d64-8f37-1ec163b39659 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1722 microversion: 2.1 time: 0.428203 Aug 31 12:32:29.966842 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 148/305] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:29 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1722 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:32:30.401628 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-757abbd9-b155-46dd-be8e-a5564770680b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:30.402367 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-757abbd9-b155-46dd-be8e-a5564770680b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:30.411825 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-757abbd9-b155-46dd-be8e-a5564770680b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:30.412617 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-757abbd9-b155-46dd-be8e-a5564770680b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:30.413235 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-757abbd9-b155-46dd-be8e-a5564770680b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:30.414430 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-757abbd9-b155-46dd-be8e-a5564770680b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:30.415108 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-757abbd9-b155-46dd-be8e-a5564770680b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:30.421576 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-757abbd9-b155-46dd-be8e-a5564770680b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:30.530609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-407aefad-6512-4adc-9f15-5d3341727b98 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:30.531421 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-407aefad-6512-4adc-9f15-5d3341727b98 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:30.555382 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-757abbd9-b155-46dd-be8e-a5564770680b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:30.557574 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-407aefad-6512-4adc-9f15-5d3341727b98 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:30.559695 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-407aefad-6512-4adc-9f15-5d3341727b98 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:30.559880 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-407aefad-6512-4adc-9f15-5d3341727b98 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:30.560828 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-407aefad-6512-4adc-9f15-5d3341727b98 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:30.561287 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-407aefad-6512-4adc-9f15-5d3341727b98 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:30.561901 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-407aefad-6512-4adc-9f15-5d3341727b98 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:30.583286 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-757abbd9-b155-46dd-be8e-a5564770680b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1303 microversion: 2.1 time: 0.178897 Aug 31 12:32:30.583286 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 158/306] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:30 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1303 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:30.997108 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-5f9b4621-dbb8-4061-ae49-47b85b43c35e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:30.998167 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-5f9b4621-dbb8-4061-ae49-47b85b43c35e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:31.016284 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5f9b4621-dbb8-4061-ae49-47b85b43c35e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:31.018938 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5f9b4621-dbb8-4061-ae49-47b85b43c35e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:31.021945 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5f9b4621-dbb8-4061-ae49-47b85b43c35e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:31.028120 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5f9b4621-dbb8-4061-ae49-47b85b43c35e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:31.029065 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5f9b4621-dbb8-4061-ae49-47b85b43c35e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:31.029867 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5f9b4621-dbb8-4061-ae49-47b85b43c35e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:31.045470 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-407aefad-6512-4adc-9f15-5d3341727b98 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:31.092882 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-407aefad-6512-4adc-9f15-5d3341727b98 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:31.096975 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-407aefad-6512-4adc-9f15-5d3341727b98 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:31.099961 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-407aefad-6512-4adc-9f15-5d3341727b98 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1740 microversion: 2.20 time: 0.574382 Aug 31 12:32:31.101118 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 149/307] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:30 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1740 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:32:31.241208 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-5f9b4621-dbb8-4061-ae49-47b85b43c35e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:31.257261 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-5f9b4621-dbb8-4061-ae49-47b85b43c35e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1722 microversion: 2.1 time: 0.266361 Aug 31 12:32:31.258154 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 159/308] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:30 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:31.604719 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-75447cd5-1f19-408e-83fd-f8cf095f7094 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:31.606579 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-75447cd5-1f19-408e-83fd-f8cf095f7094 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:31.623708 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-75447cd5-1f19-408e-83fd-f8cf095f7094 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:31.623708 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-75447cd5-1f19-408e-83fd-f8cf095f7094 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:31.624824 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-75447cd5-1f19-408e-83fd-f8cf095f7094 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:31.625798 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-75447cd5-1f19-408e-83fd-f8cf095f7094 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:31.626431 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-75447cd5-1f19-408e-83fd-f8cf095f7094 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:31.626885 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-75447cd5-1f19-408e-83fd-f8cf095f7094 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:31.948586 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-75447cd5-1f19-408e-83fd-f8cf095f7094 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:31.963167 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-75447cd5-1f19-408e-83fd-f8cf095f7094 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1371 microversion: 2.1 time: 0.364886 Aug 31 12:32:31.964346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 150/309] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:31 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1371 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:32.083820 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-512657bf-99e9-4d6e-98fa-212f9ae1f7f0 req-cca6a39b-143c-4884-bb65-a392aebf6e24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "247cb5f7-647e-4e39-8a71-99a980f3e7f6", "tag": "3294c27b-cd99-416f-b4b3-6c18cb978a29"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:32:32.099983 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-512657bf-99e9-4d6e-98fa-212f9ae1f7f0 req-cca6a39b-143c-4884-bb65-a392aebf6e24 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:32.101991 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-512657bf-99e9-4d6e-98fa-212f9ae1f7f0 req-cca6a39b-143c-4884-bb65-a392aebf6e24 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:32.103012 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-512657bf-99e9-4d6e-98fa-212f9ae1f7f0 req-cca6a39b-143c-4884-bb65-a392aebf6e24 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:32.130272 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-3217e950-ed73-4356-96de-5b82d8a7f767 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:32.131428 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-3217e950-ed73-4356-96de-5b82d8a7f767 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:32.144734 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3217e950-ed73-4356-96de-5b82d8a7f767 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:32.146948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-512657bf-99e9-4d6e-98fa-212f9ae1f7f0 req-cca6a39b-143c-4884-bb65-a392aebf6e24 service nova] Creating event network-changed:3294c27b-cd99-416f-b4b3-6c18cb978a29 for instance 247cb5f7-647e-4e39-8a71-99a980f3e7f6 on hv-cinder-85528 Aug 31 12:32:32.148329 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3217e950-ed73-4356-96de-5b82d8a7f767 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:32.151004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3217e950-ed73-4356-96de-5b82d8a7f767 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:32.154186 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3217e950-ed73-4356-96de-5b82d8a7f767 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:32.158929 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3217e950-ed73-4356-96de-5b82d8a7f767 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:32.159588 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3217e950-ed73-4356-96de-5b82d8a7f767 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:32.169532 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-512657bf-99e9-4d6e-98fa-212f9ae1f7f0 req-cca6a39b-143c-4884-bb65-a392aebf6e24 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091097 Aug 31 12:32:32.172234 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 160/310] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:32:32.281157 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-77bc19fe-c74a-496c-80fc-ede148fa6c47 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:32.282471 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-77bc19fe-c74a-496c-80fc-ede148fa6c47 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:32.295663 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-77bc19fe-c74a-496c-80fc-ede148fa6c47 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:32.296491 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-77bc19fe-c74a-496c-80fc-ede148fa6c47 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:32.297155 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-77bc19fe-c74a-496c-80fc-ede148fa6c47 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:32.298242 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-77bc19fe-c74a-496c-80fc-ede148fa6c47 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:32.300187 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-77bc19fe-c74a-496c-80fc-ede148fa6c47 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:32.300876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-77bc19fe-c74a-496c-80fc-ede148fa6c47 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:32.512017 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-3217e950-ed73-4356-96de-5b82d8a7f767 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:32.521091 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-3217e950-ed73-4356-96de-5b82d8a7f767 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:32.531604 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-3217e950-ed73-4356-96de-5b82d8a7f767 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:32.533293 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-3217e950-ed73-4356-96de-5b82d8a7f767 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1740 microversion: 2.20 time: 0.409712 Aug 31 12:32:32.537274 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 151/311] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:32 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1740 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:32:32.579304 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-77bc19fe-c74a-496c-80fc-ede148fa6c47 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:32.592940 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-77bc19fe-c74a-496c-80fc-ede148fa6c47 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1722 microversion: 2.1 time: 0.316683 Aug 31 12:32:32.594325 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 161/312] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:32 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1722 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:32:32.985393 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-4d24191a-e3f5-4da8-b836-5b6083c4fdf1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:32.986071 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-4d24191a-e3f5-4da8-b836-5b6083c4fdf1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:32.997610 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4d24191a-e3f5-4da8-b836-5b6083c4fdf1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:32.998104 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4d24191a-e3f5-4da8-b836-5b6083c4fdf1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:32.998540 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4d24191a-e3f5-4da8-b836-5b6083c4fdf1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:32.999630 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4d24191a-e3f5-4da8-b836-5b6083c4fdf1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:33.000244 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4d24191a-e3f5-4da8-b836-5b6083c4fdf1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:33.000887 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4d24191a-e3f5-4da8-b836-5b6083c4fdf1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:33.191152 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-4d24191a-e3f5-4da8-b836-5b6083c4fdf1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:33.205058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-4d24191a-e3f5-4da8-b836-5b6083c4fdf1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1371 microversion: 2.1 time: 0.223926 Aug 31 12:32:33.209672 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 152/313] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:32 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:33.587713 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-e17d6c6b-635f-483d-9463-beb99f637182 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:33.590048 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-e17d6c6b-635f-483d-9463-beb99f637182 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:33.602350 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e17d6c6b-635f-483d-9463-beb99f637182 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:33.603778 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e17d6c6b-635f-483d-9463-beb99f637182 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:33.605087 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e17d6c6b-635f-483d-9463-beb99f637182 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:33.608887 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e17d6c6b-635f-483d-9463-beb99f637182 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:33.610226 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e17d6c6b-635f-483d-9463-beb99f637182 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:33.611260 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e17d6c6b-635f-483d-9463-beb99f637182 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:33.621427 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-33eb535f-e15d-43d3-842f-134bc20fa60c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:33.622071 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-33eb535f-e15d-43d3-842f-134bc20fa60c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:33.628676 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-33eb535f-e15d-43d3-842f-134bc20fa60c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:33.629485 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-33eb535f-e15d-43d3-842f-134bc20fa60c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:33.630027 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-33eb535f-e15d-43d3-842f-134bc20fa60c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:33.630766 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-33eb535f-e15d-43d3-842f-134bc20fa60c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:33.631264 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-33eb535f-e15d-43d3-842f-134bc20fa60c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:33.631713 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-33eb535f-e15d-43d3-842f-134bc20fa60c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:33.836120 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-e17d6c6b-635f-483d-9463-beb99f637182 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:33.837601 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-33eb535f-e15d-43d3-842f-134bc20fa60c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:33.845709 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-e17d6c6b-635f-483d-9463-beb99f637182 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:33.847522 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-e17d6c6b-635f-483d-9463-beb99f637182 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:33.850502 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-33eb535f-e15d-43d3-842f-134bc20fa60c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1722 microversion: 2.1 time: 0.233758 Aug 31 12:32:33.852097 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 153/314] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:33 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:32:33.852259 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-e17d6c6b-635f-483d-9463-beb99f637182 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1740 microversion: 2.20 time: 0.269971 Aug 31 12:32:33.852845 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 162/315] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:33 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1740 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:34.265358 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-f8244a02-13a4-40e6-ba02-cd239598178e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:34.266749 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-f8244a02-13a4-40e6-ba02-cd239598178e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:34.286044 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f8244a02-13a4-40e6-ba02-cd239598178e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:34.287248 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f8244a02-13a4-40e6-ba02-cd239598178e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:34.288198 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f8244a02-13a4-40e6-ba02-cd239598178e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:34.289675 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f8244a02-13a4-40e6-ba02-cd239598178e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:34.290381 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f8244a02-13a4-40e6-ba02-cd239598178e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:34.291128 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f8244a02-13a4-40e6-ba02-cd239598178e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:34.688797 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f8244a02-13a4-40e6-ba02-cd239598178e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:34.700416 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-f8244a02-13a4-40e6-ba02-cd239598178e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1371 microversion: 2.1 time: 0.442559 Aug 31 12:32:34.701753 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 154/316] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:34 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1371 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:32:34.880585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-8a8a4760-94cf-450e-a657-21a82fd710e4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:34.881640 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-8a8a4760-94cf-450e-a657-21a82fd710e4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:34.885488 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-a5da081a-0940-4cb9-88b7-5d75037556b4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:34.886341 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-a5da081a-0940-4cb9-88b7-5d75037556b4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:34.890052 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8a8a4760-94cf-450e-a657-21a82fd710e4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:34.890722 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8a8a4760-94cf-450e-a657-21a82fd710e4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:34.891326 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8a8a4760-94cf-450e-a657-21a82fd710e4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:34.892139 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8a8a4760-94cf-450e-a657-21a82fd710e4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:34.892778 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8a8a4760-94cf-450e-a657-21a82fd710e4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:34.893244 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8a8a4760-94cf-450e-a657-21a82fd710e4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:34.894029 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a5da081a-0940-4cb9-88b7-5d75037556b4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:34.894736 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a5da081a-0940-4cb9-88b7-5d75037556b4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:34.895446 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a5da081a-0940-4cb9-88b7-5d75037556b4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:34.896569 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a5da081a-0940-4cb9-88b7-5d75037556b4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:34.897292 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a5da081a-0940-4cb9-88b7-5d75037556b4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:34.899709 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a5da081a-0940-4cb9-88b7-5d75037556b4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:34.905208 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=100 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:35.070292 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8a8a4760-94cf-450e-a657-21a82fd710e4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:35.081683 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8a8a4760-94cf-450e-a657-21a82fd710e4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:35.083401 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8a8a4760-94cf-450e-a657-21a82fd710e4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:35.084607 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-8a8a4760-94cf-450e-a657-21a82fd710e4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1740 microversion: 2.20 time: 0.210023 Aug 31 12:32:35.085160 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 163/317] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:34 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:35.200204 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-a5da081a-0940-4cb9-88b7-5d75037556b4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:35.210832 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-a5da081a-0940-4cb9-88b7-5d75037556b4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1699 microversion: 2.1 time: 0.329404 Aug 31 12:32:35.211743 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 155/318] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:34 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1699 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:32:35.233956 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-6084faff-7d43-49c2-adfb-23337909172d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:32:35.240933 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6084faff-7d43-49c2-adfb-23337909172d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:35.241431 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6084faff-7d43-49c2-adfb-23337909172d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:35.242012 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6084faff-7d43-49c2-adfb-23337909172d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:35.311137 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-6084faff-7d43-49c2-adfb-23337909172d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Going to try to start instance {{(pid=120749) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 12:32:35.392796 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-6084faff-7d43-49c2-adfb-23337909172d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "POST /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285/action" status: 202 len: 0 microversion: 2.1 time: 0.161385 Aug 31 12:32:35.399044 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 164/319] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Aug 31 12:32:35 2022] POST /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:32:35.406636 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-1c39dd15-338d-442b-b2a4-5bae83bc8c0b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:35.406636 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-1c39dd15-338d-442b-b2a4-5bae83bc8c0b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:35.419035 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1c39dd15-338d-442b-b2a4-5bae83bc8c0b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:35.419827 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1c39dd15-338d-442b-b2a4-5bae83bc8c0b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:35.420441 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1c39dd15-338d-442b-b2a4-5bae83bc8c0b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:35.421347 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1c39dd15-338d-442b-b2a4-5bae83bc8c0b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:35.421907 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1c39dd15-338d-442b-b2a4-5bae83bc8c0b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:35.422335 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1c39dd15-338d-442b-b2a4-5bae83bc8c0b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:35.728282 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-973dc8d1-4ce2-4d15-98a0-5375cc25c055 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:35.730049 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-973dc8d1-4ce2-4d15-98a0-5375cc25c055 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:35.737854 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-973dc8d1-4ce2-4d15-98a0-5375cc25c055 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:35.739720 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-973dc8d1-4ce2-4d15-98a0-5375cc25c055 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:35.740643 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-973dc8d1-4ce2-4d15-98a0-5375cc25c055 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:35.741649 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-973dc8d1-4ce2-4d15-98a0-5375cc25c055 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:35.742341 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-973dc8d1-4ce2-4d15-98a0-5375cc25c055 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:35.743077 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-973dc8d1-4ce2-4d15-98a0-5375cc25c055 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:35.859803 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-1c39dd15-338d-442b-b2a4-5bae83bc8c0b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:35.888863 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-1c39dd15-338d-442b-b2a4-5bae83bc8c0b tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1708 microversion: 2.1 time: 0.487471 Aug 31 12:32:35.897725 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 156/320] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:35 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1708 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:35.988836 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-973dc8d1-4ce2-4d15-98a0-5375cc25c055 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:35.998233 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-973dc8d1-4ce2-4d15-98a0-5375cc25c055 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1371 microversion: 2.1 time: 0.275282 Aug 31 12:32:36.001233 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 165/321] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:35 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1371 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:36.115228 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-5ebde006-7d7b-43d2-b8fa-a42c3b6ede10 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:36.116168 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-5ebde006-7d7b-43d2-b8fa-a42c3b6ede10 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:36.132310 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5ebde006-7d7b-43d2-b8fa-a42c3b6ede10 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:36.132889 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5ebde006-7d7b-43d2-b8fa-a42c3b6ede10 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:36.133335 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5ebde006-7d7b-43d2-b8fa-a42c3b6ede10 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:36.134081 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5ebde006-7d7b-43d2-b8fa-a42c3b6ede10 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:36.134545 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5ebde006-7d7b-43d2-b8fa-a42c3b6ede10 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:36.135010 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5ebde006-7d7b-43d2-b8fa-a42c3b6ede10 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:36.646889 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-5ebde006-7d7b-43d2-b8fa-a42c3b6ede10 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:36.665453 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-5ebde006-7d7b-43d2-b8fa-a42c3b6ede10 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:36.669164 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-5ebde006-7d7b-43d2-b8fa-a42c3b6ede10 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:36.671336 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-5ebde006-7d7b-43d2-b8fa-a42c3b6ede10 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1722 microversion: 2.20 time: 0.564860 Aug 31 12:32:36.686064 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 157/322] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:36 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1722 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:36.926359 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=2 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:36.928381 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=6 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:36.942437 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-cce2af76-600c-4f4f-a3fc-e3f25d8b7a45 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:36.946806 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-cce2af76-600c-4f4f-a3fc-e3f25d8b7a45 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:36.980559 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cce2af76-600c-4f4f-a3fc-e3f25d8b7a45 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:36.981300 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cce2af76-600c-4f4f-a3fc-e3f25d8b7a45 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:36.981972 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cce2af76-600c-4f4f-a3fc-e3f25d8b7a45 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:36.983431 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cce2af76-600c-4f4f-a3fc-e3f25d8b7a45 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:36.984297 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cce2af76-600c-4f4f-a3fc-e3f25d8b7a45 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:36.985079 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cce2af76-600c-4f4f-a3fc-e3f25d8b7a45 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:37.054048 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-194f2ad7-5aa0-47cd-81fe-9e96eb65b6ef tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:37.056628 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-194f2ad7-5aa0-47cd-81fe-9e96eb65b6ef tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:37.059941 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell0:SELECT=10 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:37.070720 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-194f2ad7-5aa0-47cd-81fe-9e96eb65b6ef tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:37.072129 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-194f2ad7-5aa0-47cd-81fe-9e96eb65b6ef tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:37.073063 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-194f2ad7-5aa0-47cd-81fe-9e96eb65b6ef tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:37.074436 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-194f2ad7-5aa0-47cd-81fe-9e96eb65b6ef tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:37.075265 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-194f2ad7-5aa0-47cd-81fe-9e96eb65b6ef tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:37.076188 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-194f2ad7-5aa0-47cd-81fe-9e96eb65b6ef tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:37.308055 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-cce2af76-600c-4f4f-a3fc-e3f25d8b7a45 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:37.337107 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-cce2af76-600c-4f4f-a3fc-e3f25d8b7a45 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1708 microversion: 2.1 time: 0.416015 Aug 31 12:32:37.338266 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 166/323] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:36 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1708 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:37.350725 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-194f2ad7-5aa0-47cd-81fe-9e96eb65b6ef tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:37.376386 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-194f2ad7-5aa0-47cd-81fe-9e96eb65b6ef tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1371 microversion: 2.1 time: 0.337435 Aug 31 12:32:37.377434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 158/324] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:37 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1371 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:32:37.708824 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-cfc1ef08-dc2e-4cf6-b9a0-afbc45557533 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:37.709657 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-cfc1ef08-dc2e-4cf6-b9a0-afbc45557533 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:37.718581 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cfc1ef08-dc2e-4cf6-b9a0-afbc45557533 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:37.719361 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cfc1ef08-dc2e-4cf6-b9a0-afbc45557533 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:37.719911 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cfc1ef08-dc2e-4cf6-b9a0-afbc45557533 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:37.720969 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cfc1ef08-dc2e-4cf6-b9a0-afbc45557533 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:37.721749 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cfc1ef08-dc2e-4cf6-b9a0-afbc45557533 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:37.722463 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cfc1ef08-dc2e-4cf6-b9a0-afbc45557533 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:37.908064 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-635adf41-95ca-4a41-9575-c6ee303d1512 req-f088bd6d-1b94-496f-bf6f-b5df325e9b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "247cb5f7-647e-4e39-8a71-99a980f3e7f6", "name": "network-vif-plugged", "status": "completed", "tag": "3294c27b-cd99-416f-b4b3-6c18cb978a29"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:32:37.925149 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-635adf41-95ca-4a41-9575-c6ee303d1512 req-f088bd6d-1b94-496f-bf6f-b5df325e9b42 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:37.925625 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-635adf41-95ca-4a41-9575-c6ee303d1512 req-f088bd6d-1b94-496f-bf6f-b5df325e9b42 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:37.926044 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-635adf41-95ca-4a41-9575-c6ee303d1512 req-f088bd6d-1b94-496f-bf6f-b5df325e9b42 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:37.928885 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-cfc1ef08-dc2e-4cf6-b9a0-afbc45557533 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:37.943159 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-635adf41-95ca-4a41-9575-c6ee303d1512 req-f088bd6d-1b94-496f-bf6f-b5df325e9b42 service nova] Creating event network-vif-plugged:3294c27b-cd99-416f-b4b3-6c18cb978a29 for instance 247cb5f7-647e-4e39-8a71-99a980f3e7f6 on hv-cinder-85528 Aug 31 12:32:37.947776 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-cfc1ef08-dc2e-4cf6-b9a0-afbc45557533 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:37.951310 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-cfc1ef08-dc2e-4cf6-b9a0-afbc45557533 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:37.953750 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-635adf41-95ca-4a41-9575-c6ee303d1512 req-f088bd6d-1b94-496f-bf6f-b5df325e9b42 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050077 Aug 31 12:32:37.954038 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-cfc1ef08-dc2e-4cf6-b9a0-afbc45557533 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1722 microversion: 2.20 time: 0.249259 Aug 31 12:32:37.954506 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 159/325] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:32:37.955158 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 167/326] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:37 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:38.377540 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-eb7b3716-54bb-4ac9-b0f3-d9b0800eee95 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:38.378214 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-eb7b3716-54bb-4ac9-b0f3-d9b0800eee95 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:38.386237 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-eb7b3716-54bb-4ac9-b0f3-d9b0800eee95 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:38.387162 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-eb7b3716-54bb-4ac9-b0f3-d9b0800eee95 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:38.387664 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-eb7b3716-54bb-4ac9-b0f3-d9b0800eee95 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:38.388444 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-eb7b3716-54bb-4ac9-b0f3-d9b0800eee95 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:38.388950 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-eb7b3716-54bb-4ac9-b0f3-d9b0800eee95 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:38.389434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-eb7b3716-54bb-4ac9-b0f3-d9b0800eee95 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:38.413460 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-be2d40f0-7863-441b-a081-db8023071937 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:38.414328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-be2d40f0-7863-441b-a081-db8023071937 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:38.421880 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-be2d40f0-7863-441b-a081-db8023071937 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:38.422422 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-be2d40f0-7863-441b-a081-db8023071937 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:38.422956 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-be2d40f0-7863-441b-a081-db8023071937 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:38.424039 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-be2d40f0-7863-441b-a081-db8023071937 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:38.424545 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-be2d40f0-7863-441b-a081-db8023071937 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:38.425009 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-be2d40f0-7863-441b-a081-db8023071937 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:38.611128 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-be2d40f0-7863-441b-a081-db8023071937 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:38.622158 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-be2d40f0-7863-441b-a081-db8023071937 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1371 microversion: 2.1 time: 0.212438 Aug 31 12:32:38.623211 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 168/327] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:38 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1371 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:32:38.736568 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-eb7b3716-54bb-4ac9-b0f3-d9b0800eee95 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:38.749879 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-eb7b3716-54bb-4ac9-b0f3-d9b0800eee95 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1708 microversion: 2.1 time: 0.378416 Aug 31 12:32:38.750891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 160/328] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:38 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1708 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:38.992989 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-42b0d37c-a403-4bf0-a248-d09b3f01c646 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:38.993967 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-42b0d37c-a403-4bf0-a248-d09b3f01c646 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:39.010879 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-42b0d37c-a403-4bf0-a248-d09b3f01c646 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:39.011507 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-42b0d37c-a403-4bf0-a248-d09b3f01c646 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:39.011979 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-42b0d37c-a403-4bf0-a248-d09b3f01c646 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:39.012909 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-42b0d37c-a403-4bf0-a248-d09b3f01c646 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:39.013412 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-42b0d37c-a403-4bf0-a248-d09b3f01c646 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:39.013881 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-42b0d37c-a403-4bf0-a248-d09b3f01c646 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:39.208072 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-42b0d37c-a403-4bf0-a248-d09b3f01c646 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:39.218018 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-42b0d37c-a403-4bf0-a248-d09b3f01c646 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:39.219496 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-42b0d37c-a403-4bf0-a248-d09b3f01c646 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:39.220674 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-42b0d37c-a403-4bf0-a248-d09b3f01c646 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1722 microversion: 2.20 time: 0.234083 Aug 31 12:32:39.221250 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 169/329] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:38 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:39.648898 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-38a0f116-4f3c-43bb-a3ab-8e4f81655ee7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:39.649812 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-38a0f116-4f3c-43bb-a3ab-8e4f81655ee7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:39.658128 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-38a0f116-4f3c-43bb-a3ab-8e4f81655ee7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:39.659125 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-38a0f116-4f3c-43bb-a3ab-8e4f81655ee7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:39.659830 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-38a0f116-4f3c-43bb-a3ab-8e4f81655ee7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:39.660786 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-38a0f116-4f3c-43bb-a3ab-8e4f81655ee7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:39.661285 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-38a0f116-4f3c-43bb-a3ab-8e4f81655ee7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:39.661797 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-38a0f116-4f3c-43bb-a3ab-8e4f81655ee7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:39.772690 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-aac41f44-7b1b-451f-8eef-eaea67ec8fd0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:39.773404 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-aac41f44-7b1b-451f-8eef-eaea67ec8fd0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:39.780608 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-aac41f44-7b1b-451f-8eef-eaea67ec8fd0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:39.781110 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-aac41f44-7b1b-451f-8eef-eaea67ec8fd0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:39.781545 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-aac41f44-7b1b-451f-8eef-eaea67ec8fd0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:39.782259 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-aac41f44-7b1b-451f-8eef-eaea67ec8fd0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:39.782715 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-aac41f44-7b1b-451f-8eef-eaea67ec8fd0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:39.783186 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-aac41f44-7b1b-451f-8eef-eaea67ec8fd0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:39.842580 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-38a0f116-4f3c-43bb-a3ab-8e4f81655ee7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:39.857539 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-38a0f116-4f3c-43bb-a3ab-8e4f81655ee7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1371 microversion: 2.1 time: 0.213273 Aug 31 12:32:39.858836 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 161/330] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:39 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:39.937878 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-aac41f44-7b1b-451f-8eef-eaea67ec8fd0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:39.947385 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-aac41f44-7b1b-451f-8eef-eaea67ec8fd0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1708 microversion: 2.1 time: 0.178613 Aug 31 12:32:39.948007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 170/331] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:39 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1708 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:39.980843 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-d5bc182b-f780-45ea-9817-4bde4cfc656e req-311d89d4-9bb3-48cd-ac95-8aa5ed70f78a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34ecec01-dd25-474d-addd-1d9b8de152b8", "name": "network-vif-unplugged", "status": "completed", "tag": "da6f3218-a171-4509-bd68-c737a3ff6eaf"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:32:39.991054 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-d5bc182b-f780-45ea-9817-4bde4cfc656e req-311d89d4-9bb3-48cd-ac95-8aa5ed70f78a service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:39.991540 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-d5bc182b-f780-45ea-9817-4bde4cfc656e req-311d89d4-9bb3-48cd-ac95-8aa5ed70f78a service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:39.991967 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-d5bc182b-f780-45ea-9817-4bde4cfc656e req-311d89d4-9bb3-48cd-ac95-8aa5ed70f78a service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:40.004108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-d5bc182b-f780-45ea-9817-4bde4cfc656e req-311d89d4-9bb3-48cd-ac95-8aa5ed70f78a service nova] Creating event network-vif-unplugged:da6f3218-a171-4509-bd68-c737a3ff6eaf for instance 34ecec01-dd25-474d-addd-1d9b8de152b8 on hv-cinder-85528 Aug 31 12:32:40.009429 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-d5bc182b-f780-45ea-9817-4bde4cfc656e req-311d89d4-9bb3-48cd-ac95-8aa5ed70f78a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033200 Aug 31 12:32:40.010048 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 162/332] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:32:40.246495 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-0e4771d9-4822-4cb8-8b35-af808b943611 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:40.247412 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-0e4771d9-4822-4cb8-8b35-af808b943611 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:40.256894 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0e4771d9-4822-4cb8-8b35-af808b943611 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:40.257573 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0e4771d9-4822-4cb8-8b35-af808b943611 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:40.258121 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0e4771d9-4822-4cb8-8b35-af808b943611 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:40.259269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0e4771d9-4822-4cb8-8b35-af808b943611 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:40.259940 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0e4771d9-4822-4cb8-8b35-af808b943611 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:40.261153 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0e4771d9-4822-4cb8-8b35-af808b943611 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:40.495614 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-0e4771d9-4822-4cb8-8b35-af808b943611 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:40.510927 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-0e4771d9-4822-4cb8-8b35-af808b943611 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:40.513684 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-0e4771d9-4822-4cb8-8b35-af808b943611 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:40.515893 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-0e4771d9-4822-4cb8-8b35-af808b943611 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1725 microversion: 2.20 time: 0.274777 Aug 31 12:32:40.517122 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 171/333] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:40 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1725 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:40.546176 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-8401d553-f670-46f3-afed-bd13a2bb93d8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8b03d3a-6f7e-4312-a773-c3292af64d14"}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:32:40.550756 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-8401d553-f670-46f3-afed-bd13a2bb93d8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:40.562541 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8401d553-f670-46f3-afed-bd13a2bb93d8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:40.563324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8401d553-f670-46f3-afed-bd13a2bb93d8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:40.564112 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8401d553-f670-46f3-afed-bd13a2bb93d8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:40.565325 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8401d553-f670-46f3-afed-bd13a2bb93d8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:40.565897 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8401d553-f670-46f3-afed-bd13a2bb93d8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:40.566420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8401d553-f670-46f3-afed-bd13a2bb93d8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:40.882463 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-63b66aca-4438-4cf3-8a55-7400189419a1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:40.884399 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-63b66aca-4438-4cf3-8a55-7400189419a1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:40.895432 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-63b66aca-4438-4cf3-8a55-7400189419a1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:40.896029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-63b66aca-4438-4cf3-8a55-7400189419a1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:40.896642 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-63b66aca-4438-4cf3-8a55-7400189419a1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:40.897660 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-63b66aca-4438-4cf3-8a55-7400189419a1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:40.898326 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-63b66aca-4438-4cf3-8a55-7400189419a1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:40.899183 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-63b66aca-4438-4cf3-8a55-7400189419a1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:40.924615 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-8401d553-f670-46f3-afed-bd13a2bb93d8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "POST /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.388280 Aug 31 12:32:40.925491 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 163/334] 10.222.0.79 () {62 vars in 1364 bytes} [Wed Aug 31 12:32:40 2022] POST /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8/os-volume_attachments => generated 188 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:32:40.972020 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-fc05b4d3-f95b-4440-b4f6-0dc7731fc01f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:40.972838 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-fc05b4d3-f95b-4440-b4f6-0dc7731fc01f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:40.982594 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fc05b4d3-f95b-4440-b4f6-0dc7731fc01f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:40.983442 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fc05b4d3-f95b-4440-b4f6-0dc7731fc01f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:40.983883 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fc05b4d3-f95b-4440-b4f6-0dc7731fc01f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:40.985006 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fc05b4d3-f95b-4440-b4f6-0dc7731fc01f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:40.985492 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fc05b4d3-f95b-4440-b4f6-0dc7731fc01f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:40.986129 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fc05b4d3-f95b-4440-b4f6-0dc7731fc01f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:41.090726 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-63b66aca-4438-4cf3-8a55-7400189419a1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:41.110019 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:41.116920 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-63b66aca-4438-4cf3-8a55-7400189419a1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1371 microversion: 2.1 time: 0.239678 Aug 31 12:32:41.117660 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 172/335] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:40 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:32:41.126225 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-bb89e1d7-dc94-4740-9915-d1efbb43d897 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:32:41.126225 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-bb89e1d7-dc94-4740-9915-d1efbb43d897 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:41.135407 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bb89e1d7-dc94-4740-9915-d1efbb43d897 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:41.136246 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bb89e1d7-dc94-4740-9915-d1efbb43d897 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:41.137005 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bb89e1d7-dc94-4740-9915-d1efbb43d897 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:41.138112 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bb89e1d7-dc94-4740-9915-d1efbb43d897 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:41.139348 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bb89e1d7-dc94-4740-9915-d1efbb43d897 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:41.139604 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bb89e1d7-dc94-4740-9915-d1efbb43d897 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:41.190336 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-bb89e1d7-dc94-4740-9915-d1efbb43d897 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120749) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 12:32:41.192235 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-fc05b4d3-f95b-4440-b4f6-0dc7731fc01f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:41.202262 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-fc05b4d3-f95b-4440-b4f6-0dc7731fc01f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1708 microversion: 2.1 time: 0.235078 Aug 31 12:32:41.202883 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 164/336] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:40 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1708 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:41.273405 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-bb89e1d7-dc94-4740-9915-d1efbb43d897 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "POST /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8/action" status: 202 len: 0 microversion: 2.20 time: 0.154533 Aug 31 12:32:41.273914 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 173/337] 10.222.0.79 () {62 vars in 1319 bytes} [Wed Aug 31 12:32:41 2022] POST /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:32:41.283844 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-d9835db6-f990-4b39-af5a-4f9338323816 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:41.284596 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-d9835db6-f990-4b39-af5a-4f9338323816 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:41.291132 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d9835db6-f990-4b39-af5a-4f9338323816 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:41.291705 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d9835db6-f990-4b39-af5a-4f9338323816 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:41.292141 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d9835db6-f990-4b39-af5a-4f9338323816 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:41.292995 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d9835db6-f990-4b39-af5a-4f9338323816 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:41.293453 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d9835db6-f990-4b39-af5a-4f9338323816 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:41.293881 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d9835db6-f990-4b39-af5a-4f9338323816 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:41.467550 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-d9835db6-f990-4b39-af5a-4f9338323816 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:41.478795 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-d9835db6-f990-4b39-af5a-4f9338323816 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:41.480444 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-d9835db6-f990-4b39-af5a-4f9338323816 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:41.481929 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-d9835db6-f990-4b39-af5a-4f9338323816 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1811 microversion: 2.20 time: 0.202997 Aug 31 12:32:41.482539 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 165/338] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:41 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1811 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:42.146365 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-c5a3c5d1-250a-44bb-b26b-540bbbe26738 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:42.147645 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-c5a3c5d1-250a-44bb-b26b-540bbbe26738 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:42.158225 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c5a3c5d1-250a-44bb-b26b-540bbbe26738 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:42.159140 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c5a3c5d1-250a-44bb-b26b-540bbbe26738 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:42.159882 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c5a3c5d1-250a-44bb-b26b-540bbbe26738 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:42.161165 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c5a3c5d1-250a-44bb-b26b-540bbbe26738 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:42.161967 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c5a3c5d1-250a-44bb-b26b-540bbbe26738 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:42.162753 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c5a3c5d1-250a-44bb-b26b-540bbbe26738 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:42.229747 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-a9535faf-611a-4884-abe8-99eca40f93e9 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:42.231957 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-a9535faf-611a-4884-abe8-99eca40f93e9 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:42.248048 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a9535faf-611a-4884-abe8-99eca40f93e9 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:42.249407 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a9535faf-611a-4884-abe8-99eca40f93e9 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:42.250172 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a9535faf-611a-4884-abe8-99eca40f93e9 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:42.251696 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a9535faf-611a-4884-abe8-99eca40f93e9 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:42.252949 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a9535faf-611a-4884-abe8-99eca40f93e9 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:42.254058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a9535faf-611a-4884-abe8-99eca40f93e9 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:42.495327 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-c5a3c5d1-250a-44bb-b26b-540bbbe26738 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:42.515039 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-c5a3c5d1-250a-44bb-b26b-540bbbe26738 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1371 microversion: 2.1 time: 0.376208 Aug 31 12:32:42.523178 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-a9535faf-611a-4884-abe8-99eca40f93e9 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:42.524129 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 174/339] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:42 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1371 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:42.543128 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-a9535faf-611a-4884-abe8-99eca40f93e9 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1708 microversion: 2.1 time: 0.320702 Aug 31 12:32:42.544246 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 166/340] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:42 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1708 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:42.553151 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-277c72e4-6282-4176-8f6c-c1d065c09508 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:42.554315 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-277c72e4-6282-4176-8f6c-c1d065c09508 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:42.577640 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-277c72e4-6282-4176-8f6c-c1d065c09508 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:42.578543 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-277c72e4-6282-4176-8f6c-c1d065c09508 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:42.579389 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-277c72e4-6282-4176-8f6c-c1d065c09508 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:42.580959 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-277c72e4-6282-4176-8f6c-c1d065c09508 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:42.581834 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-277c72e4-6282-4176-8f6c-c1d065c09508 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:42.582830 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-277c72e4-6282-4176-8f6c-c1d065c09508 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:42.827927 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-277c72e4-6282-4176-8f6c-c1d065c09508 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:42.868231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-277c72e4-6282-4176-8f6c-c1d065c09508 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:42.872024 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-277c72e4-6282-4176-8f6c-c1d065c09508 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:42.873779 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-277c72e4-6282-4176-8f6c-c1d065c09508 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1811 microversion: 2.20 time: 0.348291 Aug 31 12:32:42.874494 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 175/341] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:42 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1811 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:43.539480 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-bfc6c4da-d216-448a-b41f-7f4ab983a6fb tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:43.541165 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-bfc6c4da-d216-448a-b41f-7f4ab983a6fb tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:43.552836 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bfc6c4da-d216-448a-b41f-7f4ab983a6fb tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:43.553337 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bfc6c4da-d216-448a-b41f-7f4ab983a6fb tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:43.553782 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bfc6c4da-d216-448a-b41f-7f4ab983a6fb tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:43.554506 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bfc6c4da-d216-448a-b41f-7f4ab983a6fb tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:43.554986 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bfc6c4da-d216-448a-b41f-7f4ab983a6fb tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:43.555403 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bfc6c4da-d216-448a-b41f-7f4ab983a6fb tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:43.580551 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-179ad447-da81-4cd5-892b-d737c285953e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:43.581452 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-179ad447-da81-4cd5-892b-d737c285953e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:43.593412 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-179ad447-da81-4cd5-892b-d737c285953e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:43.594238 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-179ad447-da81-4cd5-892b-d737c285953e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:43.595065 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-179ad447-da81-4cd5-892b-d737c285953e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:43.596217 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-179ad447-da81-4cd5-892b-d737c285953e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:43.597070 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-179ad447-da81-4cd5-892b-d737c285953e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:43.598214 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-179ad447-da81-4cd5-892b-d737c285953e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:43.776923 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-179ad447-da81-4cd5-892b-d737c285953e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:43.785656 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-179ad447-da81-4cd5-892b-d737c285953e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1712 microversion: 2.1 time: 0.209758 Aug 31 12:32:43.786687 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 176/342] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:43 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1712 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:32:43.795025 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-bfc6c4da-d216-448a-b41f-7f4ab983a6fb tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:43.804471 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-bfc6c4da-d216-448a-b41f-7f4ab983a6fb tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1371 microversion: 2.1 time: 0.270795 Aug 31 12:32:43.805373 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 167/343] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:43 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1371 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:32:43.905345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-86d9b0e5-4060-43a5-90f8-593853a914e0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:43.906430 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-86d9b0e5-4060-43a5-90f8-593853a914e0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:43.917824 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-86d9b0e5-4060-43a5-90f8-593853a914e0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:43.918682 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-86d9b0e5-4060-43a5-90f8-593853a914e0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:43.919486 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-86d9b0e5-4060-43a5-90f8-593853a914e0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:43.920763 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-86d9b0e5-4060-43a5-90f8-593853a914e0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:43.921568 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-86d9b0e5-4060-43a5-90f8-593853a914e0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:43.922309 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-86d9b0e5-4060-43a5-90f8-593853a914e0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:44.127163 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-86d9b0e5-4060-43a5-90f8-593853a914e0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:44.139813 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-86d9b0e5-4060-43a5-90f8-593853a914e0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:44.141956 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-86d9b0e5-4060-43a5-90f8-593853a914e0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:44.143214 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-86d9b0e5-4060-43a5-90f8-593853a914e0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1811 microversion: 2.20 time: 0.244950 Aug 31 12:32:44.143835 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 177/344] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:43 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1811 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:44.835737 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-003d09da-9ed0-401f-8fbc-886e82292b80 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:44.837890 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-003d09da-9ed0-401f-8fbc-886e82292b80 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:44.847556 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-003d09da-9ed0-401f-8fbc-886e82292b80 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:44.848047 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-003d09da-9ed0-401f-8fbc-886e82292b80 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:44.848475 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-003d09da-9ed0-401f-8fbc-886e82292b80 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:44.850538 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-003d09da-9ed0-401f-8fbc-886e82292b80 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:44.852764 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-003d09da-9ed0-401f-8fbc-886e82292b80 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:44.853381 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-003d09da-9ed0-401f-8fbc-886e82292b80 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:45.020285 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-003d09da-9ed0-401f-8fbc-886e82292b80 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:45.030896 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-003d09da-9ed0-401f-8fbc-886e82292b80 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1565 microversion: 2.1 time: 0.206788 Aug 31 12:32:45.035321 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 168/345] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:44 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1565 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:45.053608 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-365ebdbe-6456-4c2a-bc0c-053e2c9a3abe tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:45.054780 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-365ebdbe-6456-4c2a-bc0c-053e2c9a3abe tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:45.062677 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-365ebdbe-6456-4c2a-bc0c-053e2c9a3abe tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:45.063212 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-365ebdbe-6456-4c2a-bc0c-053e2c9a3abe tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:45.063654 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-365ebdbe-6456-4c2a-bc0c-053e2c9a3abe tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:45.064366 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-365ebdbe-6456-4c2a-bc0c-053e2c9a3abe tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:45.064823 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-365ebdbe-6456-4c2a-bc0c-053e2c9a3abe tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:45.065247 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-365ebdbe-6456-4c2a-bc0c-053e2c9a3abe tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:45.173297 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-365ebdbe-6456-4c2a-bc0c-053e2c9a3abe tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.124500 Aug 31 12:32:45.173908 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 178/346] 10.222.0.79 () {58 vars in 1275 bytes} [Wed Aug 31 12:32:45 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:32:45.192923 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-027c2aa8-86c9-4627-b50f-38720aba0cb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:45.194215 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-027c2aa8-86c9-4627-b50f-38720aba0cb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:45.205777 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-027c2aa8-86c9-4627-b50f-38720aba0cb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:45.206778 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-027c2aa8-86c9-4627-b50f-38720aba0cb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:45.207652 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-027c2aa8-86c9-4627-b50f-38720aba0cb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:45.209043 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-027c2aa8-86c9-4627-b50f-38720aba0cb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:45.209994 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-027c2aa8-86c9-4627-b50f-38720aba0cb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:45.210882 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-027c2aa8-86c9-4627-b50f-38720aba0cb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:45.400260 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-027c2aa8-86c9-4627-b50f-38720aba0cb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:45.418467 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-027c2aa8-86c9-4627-b50f-38720aba0cb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:45.421951 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-027c2aa8-86c9-4627-b50f-38720aba0cb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:45.424206 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-027c2aa8-86c9-4627-b50f-38720aba0cb4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1753 microversion: 2.20 time: 0.238338 Aug 31 12:32:45.426008 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 169/347] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:45 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1753 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:32:46.455089 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-5fc19226-f8e1-4260-8d85-0e3258ec6071 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:46.455952 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-5fc19226-f8e1-4260-8d85-0e3258ec6071 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:46.465251 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5fc19226-f8e1-4260-8d85-0e3258ec6071 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:46.466220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5fc19226-f8e1-4260-8d85-0e3258ec6071 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:46.466830 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5fc19226-f8e1-4260-8d85-0e3258ec6071 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:46.467828 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5fc19226-f8e1-4260-8d85-0e3258ec6071 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:46.468596 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5fc19226-f8e1-4260-8d85-0e3258ec6071 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:46.469220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5fc19226-f8e1-4260-8d85-0e3258ec6071 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:46.882377 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-8aeac450-6bc0-475d-830e-11d68eeb63e7 req-469a3559-b59a-410b-a03d-7ecaf6c65de6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "247cb5f7-647e-4e39-8a71-99a980f3e7f6", "tag": "3294c27b-cd99-416f-b4b3-6c18cb978a29"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:32:46.904840 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-8aeac450-6bc0-475d-830e-11d68eeb63e7 req-469a3559-b59a-410b-a03d-7ecaf6c65de6 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:46.906072 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-8aeac450-6bc0-475d-830e-11d68eeb63e7 req-469a3559-b59a-410b-a03d-7ecaf6c65de6 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:46.907426 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-8aeac450-6bc0-475d-830e-11d68eeb63e7 req-469a3559-b59a-410b-a03d-7ecaf6c65de6 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:46.935804 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-8aeac450-6bc0-475d-830e-11d68eeb63e7 req-469a3559-b59a-410b-a03d-7ecaf6c65de6 service nova] Creating event network-changed:3294c27b-cd99-416f-b4b3-6c18cb978a29 for instance 247cb5f7-647e-4e39-8a71-99a980f3e7f6 on hv-cinder-85528 Aug 31 12:32:46.946209 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-8aeac450-6bc0-475d-830e-11d68eeb63e7 req-469a3559-b59a-410b-a03d-7ecaf6c65de6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070426 Aug 31 12:32:46.948532 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 170/348] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:32:47.036568 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-5fc19226-f8e1-4260-8d85-0e3258ec6071 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:47.053585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-5fc19226-f8e1-4260-8d85-0e3258ec6071 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:47.056181 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-5fc19226-f8e1-4260-8d85-0e3258ec6071 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:47.057599 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-5fc19226-f8e1-4260-8d85-0e3258ec6071 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1809 microversion: 2.20 time: 0.609782 Aug 31 12:32:47.058194 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 179/349] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:46 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1809 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:47.433633 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-787c2843-6f9d-4214-8ce8-43fdfe190877 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1374288733", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-280733761", "security_groups": [{"name": "tempest-secgroup-smoke-1147286286"}], "block_device_mapping_v2": [{"uuid": "1335fee3-6344-429c-8323-704764084bb0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bb498262-cecd-4350-a5a0-432fdf03b76c"}]}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:32:47.732049 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.network.neutron [None req-787c2843-6f9d-4214-8ce8-43fdfe190877 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] validate_networks() for [('bb498262-cecd-4350-a5a0-432fdf03b76c', None, None, None, None, None)] {{(pid=120750) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:32:48.095194 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-4ea1a3b2-c450-4ab9-8678-756db94d59cd tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:48.096085 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-4ea1a3b2-c450-4ab9-8678-756db94d59cd tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:48.108681 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4ea1a3b2-c450-4ab9-8678-756db94d59cd tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:48.109203 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4ea1a3b2-c450-4ab9-8678-756db94d59cd tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:48.109606 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4ea1a3b2-c450-4ab9-8678-756db94d59cd tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:48.114463 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4ea1a3b2-c450-4ab9-8678-756db94d59cd tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:48.115252 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4ea1a3b2-c450-4ab9-8678-756db94d59cd tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:48.115856 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4ea1a3b2-c450-4ab9-8678-756db94d59cd tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:48.330329 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-4ea1a3b2-c450-4ab9-8678-756db94d59cd tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:48.341687 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-4ea1a3b2-c450-4ab9-8678-756db94d59cd tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:48.347747 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-4ea1a3b2-c450-4ab9-8678-756db94d59cd tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:48.349091 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-4ea1a3b2-c450-4ab9-8678-756db94d59cd tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1809 microversion: 2.20 time: 0.258298 Aug 31 12:32:48.349667 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 180/350] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:48 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1809 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:32:48.841670 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-787c2843-6f9d-4214-8ce8-43fdfe190877 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Flavor limits 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:32:48.842756 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-787c2843-6f9d-4214-8ce8-43fdfe190877 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Image limits 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:32:48.842756 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-787c2843-6f9d-4214-8ce8-43fdfe190877 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Flavor pref 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:32:48.843189 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-787c2843-6f9d-4214-8ce8-43fdfe190877 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Image pref 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:32:48.843338 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-787c2843-6f9d-4214-8ce8-43fdfe190877 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:32:48.871632 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-787c2843-6f9d-4214-8ce8-43fdfe190877 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:48.872509 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-787c2843-6f9d-4214-8ce8-43fdfe190877 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:48.873238 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-787c2843-6f9d-4214-8ce8-43fdfe190877 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:48.874278 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-787c2843-6f9d-4214-8ce8-43fdfe190877 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:48.874776 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-787c2843-6f9d-4214-8ce8-43fdfe190877 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:48.875265 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-787c2843-6f9d-4214-8ce8-43fdfe190877 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:48.890119 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:48.911708 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-787c2843-6f9d-4214-8ce8-43fdfe190877 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Getting quotas for project b364169c30154cc8af7c9a37bebc8040. Resources: {'cores', 'ram', 'instances'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:32:48.920819 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-787c2843-6f9d-4214-8ce8-43fdfe190877 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Getting quotas for user 2e77671c123f434489d82da79212d0ab and project b364169c30154cc8af7c9a37bebc8040. Resources: {'cores', 'ram', 'instances'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:32:49.014035 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-787c2843-6f9d-4214-8ce8-43fdfe190877 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Going to run 1 instances... {{(pid=120750) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:32:49.017042 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-787c2843-6f9d-4214-8ce8-43fdfe190877 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1335fee3-6344-429c-8323-704764084bb0',volume_size=None,volume_type=None)] {{(pid=120750) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:32:49.251931 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-787c2843-6f9d-4214-8ce8-43fdfe190877 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.826964 Aug 31 12:32:49.261425 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 171/351] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 31 12:32:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 1838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:32:49.279246 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-52c1c317-f2f4-47fd-8d74-92b98c27b4f2 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:49.280001 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-52c1c317-f2f4-47fd-8d74-92b98c27b4f2 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:49.384066 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-875d1028-2c8a-454d-a6ad-5875bf346fb1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:49.385745 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-875d1028-2c8a-454d-a6ad-5875bf346fb1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:49.400322 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-875d1028-2c8a-454d-a6ad-5875bf346fb1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:49.403574 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-875d1028-2c8a-454d-a6ad-5875bf346fb1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:49.407888 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-875d1028-2c8a-454d-a6ad-5875bf346fb1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:49.408990 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-875d1028-2c8a-454d-a6ad-5875bf346fb1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:49.409416 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-52c1c317-f2f4-47fd-8d74-92b98c27b4f2 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:49.410123 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-875d1028-2c8a-454d-a6ad-5875bf346fb1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:49.414889 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-875d1028-2c8a-454d-a6ad-5875bf346fb1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:49.419698 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-52c1c317-f2f4-47fd-8d74-92b98c27b4f2 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 200 len: 1094 microversion: 2.1 time: 0.159300 Aug 31 12:32:49.426553 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 181/352] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:49 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 1094 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:32:49.704794 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-875d1028-2c8a-454d-a6ad-5875bf346fb1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:49.731851 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-875d1028-2c8a-454d-a6ad-5875bf346fb1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:49.736321 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-875d1028-2c8a-454d-a6ad-5875bf346fb1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:49.739773 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-875d1028-2c8a-454d-a6ad-5875bf346fb1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1809 microversion: 2.20 time: 0.369001 Aug 31 12:32:49.743968 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 172/353] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:49 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1809 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:32:50.446273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-4adb7f83-71c9-4607-b8ab-c424bd2c8c91 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:50.448438 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-4adb7f83-71c9-4607-b8ab-c424bd2c8c91 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:50.455460 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4adb7f83-71c9-4607-b8ab-c424bd2c8c91 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:50.455964 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4adb7f83-71c9-4607-b8ab-c424bd2c8c91 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:50.456419 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4adb7f83-71c9-4607-b8ab-c424bd2c8c91 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:50.457401 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4adb7f83-71c9-4607-b8ab-c424bd2c8c91 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:50.457919 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4adb7f83-71c9-4607-b8ab-c424bd2c8c91 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:50.458400 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4adb7f83-71c9-4607-b8ab-c424bd2c8c91 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:50.541730 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-4adb7f83-71c9-4607-b8ab-c424bd2c8c91 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:50.556557 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-4adb7f83-71c9-4607-b8ab-c424bd2c8c91 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 200 len: 1144 microversion: 2.1 time: 0.114103 Aug 31 12:32:50.558725 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 182/354] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:50 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 1144 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:50.771962 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-5b04af55-352a-422f-94f5-326a1cf2b583 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:50.774117 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-5b04af55-352a-422f-94f5-326a1cf2b583 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:50.785287 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5b04af55-352a-422f-94f5-326a1cf2b583 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:50.785987 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5b04af55-352a-422f-94f5-326a1cf2b583 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:50.786591 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5b04af55-352a-422f-94f5-326a1cf2b583 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:50.787639 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5b04af55-352a-422f-94f5-326a1cf2b583 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:50.788939 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5b04af55-352a-422f-94f5-326a1cf2b583 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:50.789907 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5b04af55-352a-422f-94f5-326a1cf2b583 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:51.014548 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-5b04af55-352a-422f-94f5-326a1cf2b583 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:51.026647 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-5b04af55-352a-422f-94f5-326a1cf2b583 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:51.029547 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-5b04af55-352a-422f-94f5-326a1cf2b583 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:51.031873 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-5b04af55-352a-422f-94f5-326a1cf2b583 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1809 microversion: 2.20 time: 0.267045 Aug 31 12:32:51.033061 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 173/355] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:50 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1809 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:51.580016 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-a997415e-2f1e-4d08-9624-935901ba79a8 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:51.580611 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-a997415e-2f1e-4d08-9624-935901ba79a8 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:51.587333 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a997415e-2f1e-4d08-9624-935901ba79a8 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:51.587822 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a997415e-2f1e-4d08-9624-935901ba79a8 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:51.589000 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a997415e-2f1e-4d08-9624-935901ba79a8 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:51.589889 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a997415e-2f1e-4d08-9624-935901ba79a8 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:51.590456 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a997415e-2f1e-4d08-9624-935901ba79a8 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:51.590843 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a997415e-2f1e-4d08-9624-935901ba79a8 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:51.673689 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-a997415e-2f1e-4d08-9624-935901ba79a8 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:51.683964 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-a997415e-2f1e-4d08-9624-935901ba79a8 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 200 len: 1144 microversion: 2.1 time: 0.107817 Aug 31 12:32:51.685133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 183/356] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:51 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 1144 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:52.078905 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-204efb70-16b1-4669-92ee-39e817002d67 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:52.080463 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-204efb70-16b1-4669-92ee-39e817002d67 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:52.090471 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-204efb70-16b1-4669-92ee-39e817002d67 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:52.091026 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-204efb70-16b1-4669-92ee-39e817002d67 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:52.091477 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-204efb70-16b1-4669-92ee-39e817002d67 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:52.092266 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-204efb70-16b1-4669-92ee-39e817002d67 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:52.092720 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-204efb70-16b1-4669-92ee-39e817002d67 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:52.093177 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-204efb70-16b1-4669-92ee-39e817002d67 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:52.294621 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-204efb70-16b1-4669-92ee-39e817002d67 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:52.312565 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-204efb70-16b1-4669-92ee-39e817002d67 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:52.315154 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-204efb70-16b1-4669-92ee-39e817002d67 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:52.316624 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-204efb70-16b1-4669-92ee-39e817002d67 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1809 microversion: 2.20 time: 0.241907 Aug 31 12:32:52.317809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 174/357] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:52 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:52.711217 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-37d55d3d-3aa5-4121-b2fa-ec9d89388c3d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:52.712206 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-37d55d3d-3aa5-4121-b2fa-ec9d89388c3d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:52.721024 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-37d55d3d-3aa5-4121-b2fa-ec9d89388c3d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:52.721609 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-37d55d3d-3aa5-4121-b2fa-ec9d89388c3d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:52.722002 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-37d55d3d-3aa5-4121-b2fa-ec9d89388c3d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:52.722796 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-37d55d3d-3aa5-4121-b2fa-ec9d89388c3d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:52.723174 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-37d55d3d-3aa5-4121-b2fa-ec9d89388c3d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:52.723608 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-37d55d3d-3aa5-4121-b2fa-ec9d89388c3d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:52.810569 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-37d55d3d-3aa5-4121-b2fa-ec9d89388c3d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:52.824850 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-37d55d3d-3aa5-4121-b2fa-ec9d89388c3d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 200 len: 1144 microversion: 2.1 time: 0.118689 Aug 31 12:32:52.826106 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 184/358] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:52 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 1144 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:53.363689 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-050208d0-2daf-40d4-ad09-61d40dc96f9f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:53.364387 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-050208d0-2daf-40d4-ad09-61d40dc96f9f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:53.371804 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-050208d0-2daf-40d4-ad09-61d40dc96f9f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:53.372698 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-050208d0-2daf-40d4-ad09-61d40dc96f9f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:53.373133 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-050208d0-2daf-40d4-ad09-61d40dc96f9f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:53.373847 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-050208d0-2daf-40d4-ad09-61d40dc96f9f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:53.374300 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-050208d0-2daf-40d4-ad09-61d40dc96f9f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:53.374720 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-050208d0-2daf-40d4-ad09-61d40dc96f9f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:53.550772 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-050208d0-2daf-40d4-ad09-61d40dc96f9f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:53.562141 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-050208d0-2daf-40d4-ad09-61d40dc96f9f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:53.564007 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-050208d0-2daf-40d4-ad09-61d40dc96f9f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:53.565314 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-050208d0-2daf-40d4-ad09-61d40dc96f9f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1809 microversion: 2.20 time: 0.214937 Aug 31 12:32:53.566226 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 175/359] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:53 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1809 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:53.847492 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-38fdf3a2-b66d-437b-b5e3-62db5e477a32 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:53.848295 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-38fdf3a2-b66d-437b-b5e3-62db5e477a32 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:53.856716 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-38fdf3a2-b66d-437b-b5e3-62db5e477a32 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:53.857359 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-38fdf3a2-b66d-437b-b5e3-62db5e477a32 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:53.857868 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-38fdf3a2-b66d-437b-b5e3-62db5e477a32 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:53.859364 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-38fdf3a2-b66d-437b-b5e3-62db5e477a32 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:53.860173 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-38fdf3a2-b66d-437b-b5e3-62db5e477a32 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:53.860891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-38fdf3a2-b66d-437b-b5e3-62db5e477a32 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:53.941428 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-38fdf3a2-b66d-437b-b5e3-62db5e477a32 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:53.951142 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-38fdf3a2-b66d-437b-b5e3-62db5e477a32 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 200 len: 1144 microversion: 2.1 time: 0.107500 Aug 31 12:32:53.951750 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 185/360] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:53 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 1144 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:54.593106 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-01ffd670-4b67-4bd9-a604-68cb08ed7632 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:54.594307 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-01ffd670-4b67-4bd9-a604-68cb08ed7632 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:54.605087 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-01ffd670-4b67-4bd9-a604-68cb08ed7632 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:54.605947 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-01ffd670-4b67-4bd9-a604-68cb08ed7632 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:54.606497 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-01ffd670-4b67-4bd9-a604-68cb08ed7632 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:54.607610 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-01ffd670-4b67-4bd9-a604-68cb08ed7632 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:54.609073 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-01ffd670-4b67-4bd9-a604-68cb08ed7632 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:54.609647 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-01ffd670-4b67-4bd9-a604-68cb08ed7632 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:54.829250 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-01ffd670-4b67-4bd9-a604-68cb08ed7632 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:54.843962 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-01ffd670-4b67-4bd9-a604-68cb08ed7632 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:54.845493 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-01ffd670-4b67-4bd9-a604-68cb08ed7632 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:54.846739 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-01ffd670-4b67-4bd9-a604-68cb08ed7632 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1809 microversion: 2.20 time: 0.259917 Aug 31 12:32:54.847356 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 176/361] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:54 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1809 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:54.979461 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-df80e3e1-665c-43f4-99e2-b8a35f632477 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:54.980389 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-df80e3e1-665c-43f4-99e2-b8a35f632477 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:54.990721 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-df80e3e1-665c-43f4-99e2-b8a35f632477 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:54.991669 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-df80e3e1-665c-43f4-99e2-b8a35f632477 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:54.992041 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-df80e3e1-665c-43f4-99e2-b8a35f632477 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:54.992797 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-df80e3e1-665c-43f4-99e2-b8a35f632477 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:54.993382 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-df80e3e1-665c-43f4-99e2-b8a35f632477 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:54.993821 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-df80e3e1-665c-43f4-99e2-b8a35f632477 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:55.079059 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-df80e3e1-665c-43f4-99e2-b8a35f632477 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:55.090162 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-df80e3e1-665c-43f4-99e2-b8a35f632477 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 200 len: 1144 microversion: 2.1 time: 0.114474 Aug 31 12:32:55.091184 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 186/362] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:54 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 1144 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:55.890910 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-ecf385b0-2e66-40e7-8f75-71422b80919a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:55.893622 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-ecf385b0-2e66-40e7-8f75-71422b80919a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:55.897346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:55.908653 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ecf385b0-2e66-40e7-8f75-71422b80919a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:55.909834 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ecf385b0-2e66-40e7-8f75-71422b80919a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:55.910777 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ecf385b0-2e66-40e7-8f75-71422b80919a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:55.912284 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ecf385b0-2e66-40e7-8f75-71422b80919a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:55.913200 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ecf385b0-2e66-40e7-8f75-71422b80919a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:55.913968 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ecf385b0-2e66-40e7-8f75-71422b80919a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:56.130046 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-ecf385b0-2e66-40e7-8f75-71422b80919a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:56.133511 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-b6b4707c-79bb-4c2c-9e10-e94b51f6b5ee tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:56.151185 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-ecf385b0-2e66-40e7-8f75-71422b80919a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:56.153261 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-ecf385b0-2e66-40e7-8f75-71422b80919a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:56.155048 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-ecf385b0-2e66-40e7-8f75-71422b80919a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1809 microversion: 2.20 time: 0.272324 Aug 31 12:32:56.155958 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-b6b4707c-79bb-4c2c-9e10-e94b51f6b5ee tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:56.156109 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 177/363] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:55 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1809 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:56.172325 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b6b4707c-79bb-4c2c-9e10-e94b51f6b5ee tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:56.175554 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b6b4707c-79bb-4c2c-9e10-e94b51f6b5ee tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:56.176211 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b6b4707c-79bb-4c2c-9e10-e94b51f6b5ee tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:56.177138 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b6b4707c-79bb-4c2c-9e10-e94b51f6b5ee tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:56.177771 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b6b4707c-79bb-4c2c-9e10-e94b51f6b5ee tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:56.178356 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b6b4707c-79bb-4c2c-9e10-e94b51f6b5ee tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:56.255780 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-b6b4707c-79bb-4c2c-9e10-e94b51f6b5ee tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:56.273319 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-b6b4707c-79bb-4c2c-9e10-e94b51f6b5ee tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 200 len: 1144 microversion: 2.1 time: 0.148170 Aug 31 12:32:56.277339 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 187/364] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:56 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 1144 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:57.203770 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-c03c8362-3429-4c94-966b-614ce1d0449c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:57.204629 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-c03c8362-3429-4c94-966b-614ce1d0449c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:57.211443 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c03c8362-3429-4c94-966b-614ce1d0449c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:57.212384 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c03c8362-3429-4c94-966b-614ce1d0449c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:57.213875 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c03c8362-3429-4c94-966b-614ce1d0449c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:57.215283 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c03c8362-3429-4c94-966b-614ce1d0449c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:57.215816 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c03c8362-3429-4c94-966b-614ce1d0449c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:57.216281 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c03c8362-3429-4c94-966b-614ce1d0449c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:57.301623 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-c1ca8279-16c4-43a3-9c7e-1934a940f6e5 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:57.303981 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-c1ca8279-16c4-43a3-9c7e-1934a940f6e5 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:57.318686 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c1ca8279-16c4-43a3-9c7e-1934a940f6e5 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:57.319689 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c1ca8279-16c4-43a3-9c7e-1934a940f6e5 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:57.320720 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c1ca8279-16c4-43a3-9c7e-1934a940f6e5 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:57.321678 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c1ca8279-16c4-43a3-9c7e-1934a940f6e5 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:57.322371 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c1ca8279-16c4-43a3-9c7e-1934a940f6e5 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:57.324938 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c1ca8279-16c4-43a3-9c7e-1934a940f6e5 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:57.409413 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-c1ca8279-16c4-43a3-9c7e-1934a940f6e5 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:57.419865 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-c1ca8279-16c4-43a3-9c7e-1934a940f6e5 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 200 len: 1144 microversion: 2.1 time: 0.125718 Aug 31 12:32:57.420567 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 188/365] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:57 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 1144 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:57.427240 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-c03c8362-3429-4c94-966b-614ce1d0449c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:57.439856 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-c03c8362-3429-4c94-966b-614ce1d0449c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:57.441336 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-c03c8362-3429-4c94-966b-614ce1d0449c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:57.442776 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-c03c8362-3429-4c94-966b-614ce1d0449c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1809 microversion: 2.20 time: 0.243624 Aug 31 12:32:57.443939 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 178/366] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:57 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1809 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:58.462697 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-3a1662e7-5373-4780-8b4e-71a8b6e8ef33 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:58.463560 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-3a1662e7-5373-4780-8b4e-71a8b6e8ef33 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:58.468301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b072971b-8f07-481d-9f8d-526d18244803 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:58.468901 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-b072971b-8f07-481d-9f8d-526d18244803 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:58.470139 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3a1662e7-5373-4780-8b4e-71a8b6e8ef33 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:58.471064 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3a1662e7-5373-4780-8b4e-71a8b6e8ef33 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:58.471064 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3a1662e7-5373-4780-8b4e-71a8b6e8ef33 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:58.471761 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3a1662e7-5373-4780-8b4e-71a8b6e8ef33 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:58.472254 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3a1662e7-5373-4780-8b4e-71a8b6e8ef33 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:58.472939 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3a1662e7-5373-4780-8b4e-71a8b6e8ef33 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:58.475589 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b072971b-8f07-481d-9f8d-526d18244803 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:58.476068 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b072971b-8f07-481d-9f8d-526d18244803 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:58.476499 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b072971b-8f07-481d-9f8d-526d18244803 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:58.477192 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b072971b-8f07-481d-9f8d-526d18244803 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:58.477637 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b072971b-8f07-481d-9f8d-526d18244803 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:58.478055 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b072971b-8f07-481d-9f8d-526d18244803 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:58.536198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-3a1662e7-5373-4780-8b4e-71a8b6e8ef33 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:58.539691 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:58.545397 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-3a1662e7-5373-4780-8b4e-71a8b6e8ef33 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 200 len: 1144 microversion: 2.1 time: 0.086509 Aug 31 12:32:58.545981 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 189/367] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:58 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:58.617603 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b072971b-8f07-481d-9f8d-526d18244803 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:58.630560 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b072971b-8f07-481d-9f8d-526d18244803 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:58.632371 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b072971b-8f07-481d-9f8d-526d18244803 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:58.633565 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b072971b-8f07-481d-9f8d-526d18244803 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1809 microversion: 2.20 time: 0.169253 Aug 31 12:32:58.634309 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 179/368] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:58 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:32:59.567597 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-4fdebead-3eb5-46bb-9be6-eef0a0d75bc9 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:59.568446 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-4fdebead-3eb5-46bb-9be6-eef0a0d75bc9 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:59.570794 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=2 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:59.572226 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:59.578821 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4fdebead-3eb5-46bb-9be6-eef0a0d75bc9 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:59.579333 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4fdebead-3eb5-46bb-9be6-eef0a0d75bc9 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:59.579770 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4fdebead-3eb5-46bb-9be6-eef0a0d75bc9 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:59.580471 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4fdebead-3eb5-46bb-9be6-eef0a0d75bc9 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:59.580926 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4fdebead-3eb5-46bb-9be6-eef0a0d75bc9 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:59.581350 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4fdebead-3eb5-46bb-9be6-eef0a0d75bc9 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:59.653287 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-4fdebead-3eb5-46bb-9be6-eef0a0d75bc9 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:59.659303 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-f21a979e-4633-4cff-ac7a-8fce0a150ded tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:32:59.659904 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-f21a979e-4633-4cff-ac7a-8fce0a150ded tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:32:59.661249 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-4fdebead-3eb5-46bb-9be6-eef0a0d75bc9 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 200 len: 1192 microversion: 2.1 time: 0.098078 Aug 31 12:32:59.661724 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell0:SELECT=2 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:59.661866 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 190/369] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:32:59 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 1192 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:32:59.662963 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell0:SELECT=6 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:32:59.669748 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f21a979e-4633-4cff-ac7a-8fce0a150ded tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:59.670164 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f21a979e-4633-4cff-ac7a-8fce0a150ded tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:59.670595 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f21a979e-4633-4cff-ac7a-8fce0a150ded tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:59.671311 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f21a979e-4633-4cff-ac7a-8fce0a150ded tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:32:59.671761 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f21a979e-4633-4cff-ac7a-8fce0a150ded tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:32:59.672182 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f21a979e-4633-4cff-ac7a-8fce0a150ded tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:32:59.810456 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f21a979e-4633-4cff-ac7a-8fce0a150ded tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:59.822998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f21a979e-4633-4cff-ac7a-8fce0a150ded tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:59.825658 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f21a979e-4633-4cff-ac7a-8fce0a150ded tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:32:59.826895 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-f21a979e-4633-4cff-ac7a-8fce0a150ded tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1809 microversion: 2.20 time: 0.171502 Aug 31 12:32:59.827445 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 180/370] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:32:59 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:33:00.689139 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-9b78425c-c286-4c4e-8776-7a90e71db460 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:00.690944 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-9b78425c-c286-4c4e-8776-7a90e71db460 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:00.700381 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9b78425c-c286-4c4e-8776-7a90e71db460 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:00.700807 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9b78425c-c286-4c4e-8776-7a90e71db460 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:00.701250 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9b78425c-c286-4c4e-8776-7a90e71db460 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:00.702016 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9b78425c-c286-4c4e-8776-7a90e71db460 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:00.702478 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9b78425c-c286-4c4e-8776-7a90e71db460 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:00.702947 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9b78425c-c286-4c4e-8776-7a90e71db460 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:00.853280 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-fcb24564-ad9d-42cf-808e-4864b8cc5246 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:00.855471 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-fcb24564-ad9d-42cf-808e-4864b8cc5246 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:00.863350 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fcb24564-ad9d-42cf-808e-4864b8cc5246 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:00.864223 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fcb24564-ad9d-42cf-808e-4864b8cc5246 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:00.864905 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fcb24564-ad9d-42cf-808e-4864b8cc5246 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:00.865833 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fcb24564-ad9d-42cf-808e-4864b8cc5246 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:00.865971 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-9b78425c-c286-4c4e-8776-7a90e71db460 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:00.866693 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fcb24564-ad9d-42cf-808e-4864b8cc5246 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:00.867362 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fcb24564-ad9d-42cf-808e-4864b8cc5246 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:00.877232 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-9b78425c-c286-4c4e-8776-7a90e71db460 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 200 len: 1266 microversion: 2.1 time: 0.197367 Aug 31 12:33:00.877460 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 191/371] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:00 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:01.101061 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-fcb24564-ad9d-42cf-808e-4864b8cc5246 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:01.120333 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-fcb24564-ad9d-42cf-808e-4864b8cc5246 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:01.123627 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-fcb24564-ad9d-42cf-808e-4864b8cc5246 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:01.126003 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-fcb24564-ad9d-42cf-808e-4864b8cc5246 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1809 microversion: 2.20 time: 0.276524 Aug 31 12:33:01.127107 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 181/372] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:33:00 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1809 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:33:01.416975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-d0ad3ca7-2a8e-4657-afc7-eb2116f7361a req-404a681f-1164-44f6-b8c3-1f29c73a09e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "688b1262-46e9-4330-b633-05fc6a28cee3", "tag": "67e6c039-8531-4434-9617-4b63cd64bdce"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:33:01.429914 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-d0ad3ca7-2a8e-4657-afc7-eb2116f7361a req-404a681f-1164-44f6-b8c3-1f29c73a09e2 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:01.430739 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-d0ad3ca7-2a8e-4657-afc7-eb2116f7361a req-404a681f-1164-44f6-b8c3-1f29c73a09e2 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:01.431223 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-d0ad3ca7-2a8e-4657-afc7-eb2116f7361a req-404a681f-1164-44f6-b8c3-1f29c73a09e2 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:01.445321 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-d0ad3ca7-2a8e-4657-afc7-eb2116f7361a req-404a681f-1164-44f6-b8c3-1f29c73a09e2 service nova] Creating event network-changed:67e6c039-8531-4434-9617-4b63cd64bdce for instance 688b1262-46e9-4330-b633-05fc6a28cee3 on hv-cinder-85528 Aug 31 12:33:01.454681 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-d0ad3ca7-2a8e-4657-afc7-eb2116f7361a req-404a681f-1164-44f6-b8c3-1f29c73a09e2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042090 Aug 31 12:33:01.455327 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 192/373] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:33:01.901494 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-bd07d197-122e-4084-9d52-9a2f87561fc8 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:01.902526 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-bd07d197-122e-4084-9d52-9a2f87561fc8 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:01.909195 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bd07d197-122e-4084-9d52-9a2f87561fc8 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:01.909794 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bd07d197-122e-4084-9d52-9a2f87561fc8 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:01.910222 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bd07d197-122e-4084-9d52-9a2f87561fc8 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:01.911271 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bd07d197-122e-4084-9d52-9a2f87561fc8 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:01.911748 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bd07d197-122e-4084-9d52-9a2f87561fc8 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:01.912213 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bd07d197-122e-4084-9d52-9a2f87561fc8 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:02.079327 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-bd07d197-122e-4084-9d52-9a2f87561fc8 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:02.092685 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-bd07d197-122e-4084-9d52-9a2f87561fc8 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 200 len: 1266 microversion: 2.1 time: 0.197341 Aug 31 12:33:02.093514 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 182/374] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:01 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:02.153225 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-f68d1a6b-c49e-43ea-b15b-f38ecaa3131f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:02.153935 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-f68d1a6b-c49e-43ea-b15b-f38ecaa3131f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:02.160602 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f68d1a6b-c49e-43ea-b15b-f38ecaa3131f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:02.161103 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f68d1a6b-c49e-43ea-b15b-f38ecaa3131f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:02.161549 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f68d1a6b-c49e-43ea-b15b-f38ecaa3131f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:02.162257 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f68d1a6b-c49e-43ea-b15b-f38ecaa3131f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:02.162713 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f68d1a6b-c49e-43ea-b15b-f38ecaa3131f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:02.163166 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f68d1a6b-c49e-43ea-b15b-f38ecaa3131f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:02.362398 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-f68d1a6b-c49e-43ea-b15b-f38ecaa3131f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:02.373585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-f68d1a6b-c49e-43ea-b15b-f38ecaa3131f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:02.375133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-f68d1a6b-c49e-43ea-b15b-f38ecaa3131f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:02.376309 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-f68d1a6b-c49e-43ea-b15b-f38ecaa3131f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1809 microversion: 2.20 time: 0.229628 Aug 31 12:33:02.376882 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 193/375] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:33:02 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1809 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:33:03.113342 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-41aa9c25-b25b-46bb-92cd-bdd2ee917132 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:03.113932 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-41aa9c25-b25b-46bb-92cd-bdd2ee917132 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:03.120919 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-41aa9c25-b25b-46bb-92cd-bdd2ee917132 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:03.121435 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-41aa9c25-b25b-46bb-92cd-bdd2ee917132 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:03.121859 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-41aa9c25-b25b-46bb-92cd-bdd2ee917132 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:03.122557 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-41aa9c25-b25b-46bb-92cd-bdd2ee917132 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:03.123050 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-41aa9c25-b25b-46bb-92cd-bdd2ee917132 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:03.123470 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-41aa9c25-b25b-46bb-92cd-bdd2ee917132 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:03.263178 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-41aa9c25-b25b-46bb-92cd-bdd2ee917132 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:03.271699 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-41aa9c25-b25b-46bb-92cd-bdd2ee917132 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 200 len: 1266 microversion: 2.1 time: 0.162193 Aug 31 12:33:03.272290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 183/376] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:03 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:03.403669 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-d0531ca0-a167-4316-9478-dd96e72aa4b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:03.404663 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-d0531ca0-a167-4316-9478-dd96e72aa4b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:03.414890 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d0531ca0-a167-4316-9478-dd96e72aa4b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:03.415655 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d0531ca0-a167-4316-9478-dd96e72aa4b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:03.416843 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d0531ca0-a167-4316-9478-dd96e72aa4b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:03.417628 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d0531ca0-a167-4316-9478-dd96e72aa4b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:03.418202 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d0531ca0-a167-4316-9478-dd96e72aa4b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:03.418663 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d0531ca0-a167-4316-9478-dd96e72aa4b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:03.601760 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-d0531ca0-a167-4316-9478-dd96e72aa4b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:03.618630 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-d0531ca0-a167-4316-9478-dd96e72aa4b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:03.621568 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-d0531ca0-a167-4316-9478-dd96e72aa4b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:03.623839 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-d0531ca0-a167-4316-9478-dd96e72aa4b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1809 microversion: 2.20 time: 0.226740 Aug 31 12:33:03.624861 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 194/377] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:33:03 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1809 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:33:04.293599 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-8b506277-27a1-4ea5-bb14-e8e9bc75cac4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:04.294384 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-8b506277-27a1-4ea5-bb14-e8e9bc75cac4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:04.300402 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8b506277-27a1-4ea5-bb14-e8e9bc75cac4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:04.300896 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8b506277-27a1-4ea5-bb14-e8e9bc75cac4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:04.301326 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8b506277-27a1-4ea5-bb14-e8e9bc75cac4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:04.302035 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8b506277-27a1-4ea5-bb14-e8e9bc75cac4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:04.302489 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8b506277-27a1-4ea5-bb14-e8e9bc75cac4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:04.302944 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8b506277-27a1-4ea5-bb14-e8e9bc75cac4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:04.438053 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-8b506277-27a1-4ea5-bb14-e8e9bc75cac4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:04.446380 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-8b506277-27a1-4ea5-bb14-e8e9bc75cac4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 200 len: 1266 microversion: 2.1 time: 0.156737 Aug 31 12:33:04.447022 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 184/378] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:04 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:04.661538 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-8a1dcbc5-92e5-40f9-a51a-8f263cde24e5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:04.662186 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-8a1dcbc5-92e5-40f9-a51a-8f263cde24e5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:04.673721 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8a1dcbc5-92e5-40f9-a51a-8f263cde24e5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:04.678798 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8a1dcbc5-92e5-40f9-a51a-8f263cde24e5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:04.679309 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8a1dcbc5-92e5-40f9-a51a-8f263cde24e5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:04.680071 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8a1dcbc5-92e5-40f9-a51a-8f263cde24e5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:04.680543 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8a1dcbc5-92e5-40f9-a51a-8f263cde24e5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:04.680969 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8a1dcbc5-92e5-40f9-a51a-8f263cde24e5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:04.828497 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8a1dcbc5-92e5-40f9-a51a-8f263cde24e5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:04.837536 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8a1dcbc5-92e5-40f9-a51a-8f263cde24e5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:04.839831 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8a1dcbc5-92e5-40f9-a51a-8f263cde24e5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:04.840976 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-8a1dcbc5-92e5-40f9-a51a-8f263cde24e5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1809 microversion: 2.20 time: 0.183424 Aug 31 12:33:04.841618 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 195/379] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:33:04 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:33:05.467636 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-3f39b15e-fff2-49be-9fac-c4b6172d2cb4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:05.468230 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-3f39b15e-fff2-49be-9fac-c4b6172d2cb4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:05.474301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3f39b15e-fff2-49be-9fac-c4b6172d2cb4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:05.474778 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3f39b15e-fff2-49be-9fac-c4b6172d2cb4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:05.475275 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3f39b15e-fff2-49be-9fac-c4b6172d2cb4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:05.475958 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3f39b15e-fff2-49be-9fac-c4b6172d2cb4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:05.476403 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3f39b15e-fff2-49be-9fac-c4b6172d2cb4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:05.476819 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3f39b15e-fff2-49be-9fac-c4b6172d2cb4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:05.614838 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-3f39b15e-fff2-49be-9fac-c4b6172d2cb4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:05.623980 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-3f39b15e-fff2-49be-9fac-c4b6172d2cb4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 200 len: 1266 microversion: 2.1 time: 0.160773 Aug 31 12:33:05.624560 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 185/380] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:05 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:05.866945 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-58a8a2fb-9dae-4fac-8ee6-703c7ec4697f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:05.867683 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-58a8a2fb-9dae-4fac-8ee6-703c7ec4697f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:05.879067 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-58a8a2fb-9dae-4fac-8ee6-703c7ec4697f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:05.879950 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-58a8a2fb-9dae-4fac-8ee6-703c7ec4697f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:05.880733 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-58a8a2fb-9dae-4fac-8ee6-703c7ec4697f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:05.881856 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-58a8a2fb-9dae-4fac-8ee6-703c7ec4697f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:05.882340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-58a8a2fb-9dae-4fac-8ee6-703c7ec4697f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:05.882777 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-58a8a2fb-9dae-4fac-8ee6-703c7ec4697f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:06.034088 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-58a8a2fb-9dae-4fac-8ee6-703c7ec4697f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:06.043996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-58a8a2fb-9dae-4fac-8ee6-703c7ec4697f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:06.045436 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-58a8a2fb-9dae-4fac-8ee6-703c7ec4697f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:06.046613 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-58a8a2fb-9dae-4fac-8ee6-703c7ec4697f tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1809 microversion: 2.20 time: 0.184808 Aug 31 12:33:06.047206 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 196/381] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:33:05 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:33:06.645529 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-de809cae-b95a-44f4-ba4b-994322b1d125 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:06.646167 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-de809cae-b95a-44f4-ba4b-994322b1d125 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:06.652689 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-de809cae-b95a-44f4-ba4b-994322b1d125 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:06.653173 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-de809cae-b95a-44f4-ba4b-994322b1d125 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:06.653599 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-de809cae-b95a-44f4-ba4b-994322b1d125 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:06.654292 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-de809cae-b95a-44f4-ba4b-994322b1d125 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:06.654738 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-de809cae-b95a-44f4-ba4b-994322b1d125 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:06.655179 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-de809cae-b95a-44f4-ba4b-994322b1d125 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:06.814336 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-de809cae-b95a-44f4-ba4b-994322b1d125 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:06.822896 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-de809cae-b95a-44f4-ba4b-994322b1d125 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 200 len: 1266 microversion: 2.1 time: 0.181013 Aug 31 12:33:06.823743 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 186/382] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:06 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:07.071547 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-3242a201-bcbb-4e30-9f4b-8012b6d5d815 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:07.072688 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-3242a201-bcbb-4e30-9f4b-8012b6d5d815 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:07.085380 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3242a201-bcbb-4e30-9f4b-8012b6d5d815 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:07.085879 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3242a201-bcbb-4e30-9f4b-8012b6d5d815 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:07.086322 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3242a201-bcbb-4e30-9f4b-8012b6d5d815 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:07.087091 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3242a201-bcbb-4e30-9f4b-8012b6d5d815 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:07.087545 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3242a201-bcbb-4e30-9f4b-8012b6d5d815 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:07.087971 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3242a201-bcbb-4e30-9f4b-8012b6d5d815 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:07.266592 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-3242a201-bcbb-4e30-9f4b-8012b6d5d815 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:07.277857 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-3242a201-bcbb-4e30-9f4b-8012b6d5d815 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:07.280719 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-3242a201-bcbb-4e30-9f4b-8012b6d5d815 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:07.282105 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-3242a201-bcbb-4e30-9f4b-8012b6d5d815 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1809 microversion: 2.20 time: 0.216160 Aug 31 12:33:07.283253 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 197/383] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:33:07 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:33:07.845106 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-a0a5308a-5443-4246-927e-235443f1d180 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:07.846454 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-a0a5308a-5443-4246-927e-235443f1d180 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:07.852823 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a0a5308a-5443-4246-927e-235443f1d180 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:07.853314 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a0a5308a-5443-4246-927e-235443f1d180 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:07.853828 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a0a5308a-5443-4246-927e-235443f1d180 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:07.854588 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a0a5308a-5443-4246-927e-235443f1d180 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:07.855324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a0a5308a-5443-4246-927e-235443f1d180 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:07.855768 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a0a5308a-5443-4246-927e-235443f1d180 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:07.993346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-a0a5308a-5443-4246-927e-235443f1d180 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:08.002373 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-a0a5308a-5443-4246-927e-235443f1d180 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 200 len: 1266 microversion: 2.1 time: 0.161261 Aug 31 12:33:08.002976 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 187/384] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:07 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:08.306491 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-6c7e5f23-69b4-4d5e-8981-67ffbf11be40 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:08.307183 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-6c7e5f23-69b4-4d5e-8981-67ffbf11be40 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:08.314341 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6c7e5f23-69b4-4d5e-8981-67ffbf11be40 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:08.314837 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6c7e5f23-69b4-4d5e-8981-67ffbf11be40 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:08.315310 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6c7e5f23-69b4-4d5e-8981-67ffbf11be40 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:08.316049 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6c7e5f23-69b4-4d5e-8981-67ffbf11be40 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:08.316507 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6c7e5f23-69b4-4d5e-8981-67ffbf11be40 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:08.316931 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6c7e5f23-69b4-4d5e-8981-67ffbf11be40 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:08.466322 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-6c7e5f23-69b4-4d5e-8981-67ffbf11be40 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:08.475337 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-6c7e5f23-69b4-4d5e-8981-67ffbf11be40 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:08.476795 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-6c7e5f23-69b4-4d5e-8981-67ffbf11be40 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:08.477974 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-6c7e5f23-69b4-4d5e-8981-67ffbf11be40 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1809 microversion: 2.20 time: 0.175548 Aug 31 12:33:08.478534 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 198/385] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:33:08 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:33:08.729829 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-7fe8cf5e-02a9-4a7f-a407-201b4fe0e413 req-2c17c9c7-071e-48bf-a033-f361878b3f22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34ecec01-dd25-474d-addd-1d9b8de152b8", "name": "network-vif-plugged", "status": "completed", "tag": "da6f3218-a171-4509-bd68-c737a3ff6eaf"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:33:08.742612 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-7fe8cf5e-02a9-4a7f-a407-201b4fe0e413 req-2c17c9c7-071e-48bf-a033-f361878b3f22 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:08.743200 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-7fe8cf5e-02a9-4a7f-a407-201b4fe0e413 req-2c17c9c7-071e-48bf-a033-f361878b3f22 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:08.744062 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-7fe8cf5e-02a9-4a7f-a407-201b4fe0e413 req-2c17c9c7-071e-48bf-a033-f361878b3f22 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:08.756643 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-7fe8cf5e-02a9-4a7f-a407-201b4fe0e413 req-2c17c9c7-071e-48bf-a033-f361878b3f22 service nova] Creating event network-vif-plugged:da6f3218-a171-4509-bd68-c737a3ff6eaf for instance 34ecec01-dd25-474d-addd-1d9b8de152b8 on hv-cinder-85528 Aug 31 12:33:08.762382 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-7fe8cf5e-02a9-4a7f-a407-201b4fe0e413 req-2c17c9c7-071e-48bf-a033-f361878b3f22 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037143 Aug 31 12:33:08.763391 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 188/386] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:33:09.024565 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-44b0b28f-6786-4ee2-9588-c079c2c697ee tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:09.025182 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-44b0b28f-6786-4ee2-9588-c079c2c697ee tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:09.031875 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-44b0b28f-6786-4ee2-9588-c079c2c697ee tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:09.032354 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-44b0b28f-6786-4ee2-9588-c079c2c697ee tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:09.032781 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-44b0b28f-6786-4ee2-9588-c079c2c697ee tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:09.033486 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-44b0b28f-6786-4ee2-9588-c079c2c697ee tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:09.033931 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-44b0b28f-6786-4ee2-9588-c079c2c697ee tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:09.034346 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-44b0b28f-6786-4ee2-9588-c079c2c697ee tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:09.177856 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-44b0b28f-6786-4ee2-9588-c079c2c697ee tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:09.186340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-44b0b28f-6786-4ee2-9588-c079c2c697ee tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 200 len: 1266 microversion: 2.1 time: 0.165408 Aug 31 12:33:09.187212 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 199/387] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:09 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:09.502511 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-f0a9ddc1-c7d4-46c7-8962-cb718b76bfe9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:09.503278 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-f0a9ddc1-c7d4-46c7-8962-cb718b76bfe9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:09.512311 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f0a9ddc1-c7d4-46c7-8962-cb718b76bfe9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:09.512812 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f0a9ddc1-c7d4-46c7-8962-cb718b76bfe9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:09.513249 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f0a9ddc1-c7d4-46c7-8962-cb718b76bfe9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:09.513968 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f0a9ddc1-c7d4-46c7-8962-cb718b76bfe9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:09.514652 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f0a9ddc1-c7d4-46c7-8962-cb718b76bfe9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:09.515252 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f0a9ddc1-c7d4-46c7-8962-cb718b76bfe9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:09.520110 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=100 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:33:09.668009 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f0a9ddc1-c7d4-46c7-8962-cb718b76bfe9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:09.677488 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f0a9ddc1-c7d4-46c7-8962-cb718b76bfe9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:09.679238 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f0a9ddc1-c7d4-46c7-8962-cb718b76bfe9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:09.680432 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-f0a9ddc1-c7d4-46c7-8962-cb718b76bfe9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1809 microversion: 2.20 time: 0.182509 Aug 31 12:33:09.681006 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 189/388] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:33:09 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:33:10.208319 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-f0746f93-8a30-43db-9d32-4d156f386c3c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:10.209031 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-f0746f93-8a30-43db-9d32-4d156f386c3c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:10.216898 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f0746f93-8a30-43db-9d32-4d156f386c3c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:10.217401 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f0746f93-8a30-43db-9d32-4d156f386c3c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:10.217845 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f0746f93-8a30-43db-9d32-4d156f386c3c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:10.218566 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f0746f93-8a30-43db-9d32-4d156f386c3c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:10.219061 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f0746f93-8a30-43db-9d32-4d156f386c3c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:10.219492 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f0746f93-8a30-43db-9d32-4d156f386c3c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:10.360457 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-f0746f93-8a30-43db-9d32-4d156f386c3c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:10.368239 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-f0746f93-8a30-43db-9d32-4d156f386c3c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 200 len: 1266 microversion: 2.1 time: 0.164218 Aug 31 12:33:10.368795 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 200/389] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:10 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:10.704392 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-ca9e04cd-e84a-4b68-8ebe-e86eef58f9f2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:10.704953 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-ca9e04cd-e84a-4b68-8ebe-e86eef58f9f2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:10.711265 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ca9e04cd-e84a-4b68-8ebe-e86eef58f9f2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:10.711872 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ca9e04cd-e84a-4b68-8ebe-e86eef58f9f2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:10.712418 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ca9e04cd-e84a-4b68-8ebe-e86eef58f9f2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:10.713710 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ca9e04cd-e84a-4b68-8ebe-e86eef58f9f2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:10.714157 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ca9e04cd-e84a-4b68-8ebe-e86eef58f9f2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:10.714743 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ca9e04cd-e84a-4b68-8ebe-e86eef58f9f2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:10.889737 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-ca9e04cd-e84a-4b68-8ebe-e86eef58f9f2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:10.900058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-ca9e04cd-e84a-4b68-8ebe-e86eef58f9f2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:10.902134 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-ca9e04cd-e84a-4b68-8ebe-e86eef58f9f2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:10.903352 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-ca9e04cd-e84a-4b68-8ebe-e86eef58f9f2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1809 microversion: 2.20 time: 0.203026 Aug 31 12:33:10.903915 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 190/390] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:33:10 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1809 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:33:11.390450 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-c34c5e53-2b08-4053-acca-bbf14318a46d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:11.391149 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-c34c5e53-2b08-4053-acca-bbf14318a46d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:11.394992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:33:11.395208 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Wed Aug 31 12:33:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 (ip 10.222.0.79) !!! Aug 31 12:33:11.402755 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c34c5e53-2b08-4053-acca-bbf14318a46d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:11.403341 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c34c5e53-2b08-4053-acca-bbf14318a46d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:11.403771 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c34c5e53-2b08-4053-acca-bbf14318a46d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:11.404599 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c34c5e53-2b08-4053-acca-bbf14318a46d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:11.404923 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c34c5e53-2b08-4053-acca-bbf14318a46d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:11.405402 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c34c5e53-2b08-4053-acca-bbf14318a46d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:11.573638 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-c34c5e53-2b08-4053-acca-bbf14318a46d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:11.583148 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-c34c5e53-2b08-4053-acca-bbf14318a46d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 200 len: 1266 microversion: 2.1 time: 0.196615 Aug 31 12:33:11.583832 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 201/391] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:11 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:33:11.933276 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-553ed8cc-01a7-463d-acb1-c78c95abfc28 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:11.934122 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-553ed8cc-01a7-463d-acb1-c78c95abfc28 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:11.940726 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-553ed8cc-01a7-463d-acb1-c78c95abfc28 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:11.941325 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-553ed8cc-01a7-463d-acb1-c78c95abfc28 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:11.941940 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-553ed8cc-01a7-463d-acb1-c78c95abfc28 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:11.942680 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-553ed8cc-01a7-463d-acb1-c78c95abfc28 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:11.943379 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-553ed8cc-01a7-463d-acb1-c78c95abfc28 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:11.943889 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-553ed8cc-01a7-463d-acb1-c78c95abfc28 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:12.084587 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-553ed8cc-01a7-463d-acb1-c78c95abfc28 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:12.096758 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-553ed8cc-01a7-463d-acb1-c78c95abfc28 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:12.098196 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-553ed8cc-01a7-463d-acb1-c78c95abfc28 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:12.099411 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-553ed8cc-01a7-463d-acb1-c78c95abfc28 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1796 microversion: 2.20 time: 0.170908 Aug 31 12:33:12.099986 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 191/392] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:33:11 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1796 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:33:12.607237 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-44f0b98b-15e1-4f2a-9d6e-c331f20012a4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:12.607967 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-44f0b98b-15e1-4f2a-9d6e-c331f20012a4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:12.615975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-44f0b98b-15e1-4f2a-9d6e-c331f20012a4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:12.616700 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-44f0b98b-15e1-4f2a-9d6e-c331f20012a4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:12.617147 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-44f0b98b-15e1-4f2a-9d6e-c331f20012a4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:12.618119 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-44f0b98b-15e1-4f2a-9d6e-c331f20012a4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:12.618713 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-44f0b98b-15e1-4f2a-9d6e-c331f20012a4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:12.619193 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-44f0b98b-15e1-4f2a-9d6e-c331f20012a4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:12.750685 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-d978923d-6376-4508-b9ca-8597fc559cd6 req-b5c314d2-fbf4-43cb-bd66-11e6d5aedfff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688b1262-46e9-4330-b633-05fc6a28cee3", "name": "network-vif-plugged", "status": "completed", "tag": "67e6c039-8531-4434-9617-4b63cd64bdce"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:33:12.762418 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-d978923d-6376-4508-b9ca-8597fc559cd6 req-b5c314d2-fbf4-43cb-bd66-11e6d5aedfff service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:12.763313 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-d978923d-6376-4508-b9ca-8597fc559cd6 req-b5c314d2-fbf4-43cb-bd66-11e6d5aedfff service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:12.763779 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-d978923d-6376-4508-b9ca-8597fc559cd6 req-b5c314d2-fbf4-43cb-bd66-11e6d5aedfff service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:12.777542 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-d978923d-6376-4508-b9ca-8597fc559cd6 req-b5c314d2-fbf4-43cb-bd66-11e6d5aedfff service nova] Creating event network-vif-plugged:67e6c039-8531-4434-9617-4b63cd64bdce for instance 688b1262-46e9-4330-b633-05fc6a28cee3 on hv-cinder-85528 Aug 31 12:33:12.782958 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-d978923d-6376-4508-b9ca-8597fc559cd6 req-b5c314d2-fbf4-43cb-bd66-11e6d5aedfff service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036711 Aug 31 12:33:12.783765 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 192/393] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:33:12.792496 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-44f0b98b-15e1-4f2a-9d6e-c331f20012a4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:12.800653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-44f0b98b-15e1-4f2a-9d6e-c331f20012a4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 200 len: 1266 microversion: 2.1 time: 0.198703 Aug 31 12:33:12.801401 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 202/394] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:12 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:13.823787 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-8a65aef2-6ffb-41ff-aa82-8beb6a139507 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:13.824681 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-8a65aef2-6ffb-41ff-aa82-8beb6a139507 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:13.831094 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8a65aef2-6ffb-41ff-aa82-8beb6a139507 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:13.831754 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8a65aef2-6ffb-41ff-aa82-8beb6a139507 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:13.832293 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8a65aef2-6ffb-41ff-aa82-8beb6a139507 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:13.833257 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8a65aef2-6ffb-41ff-aa82-8beb6a139507 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:13.833841 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8a65aef2-6ffb-41ff-aa82-8beb6a139507 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:13.834311 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8a65aef2-6ffb-41ff-aa82-8beb6a139507 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:13.981286 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-8a65aef2-6ffb-41ff-aa82-8beb6a139507 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:13.989708 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-8a65aef2-6ffb-41ff-aa82-8beb6a139507 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 200 len: 1266 microversion: 2.1 time: 0.171094 Aug 31 12:33:13.990280 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 193/395] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:13 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:33:15.012102 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-ddbdcf52-cd20-4a72-90ea-65e58d99837b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:15.012705 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-ddbdcf52-cd20-4a72-90ea-65e58d99837b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:15.019620 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ddbdcf52-cd20-4a72-90ea-65e58d99837b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:15.020093 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ddbdcf52-cd20-4a72-90ea-65e58d99837b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:15.020575 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ddbdcf52-cd20-4a72-90ea-65e58d99837b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:15.021288 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ddbdcf52-cd20-4a72-90ea-65e58d99837b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:15.021744 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ddbdcf52-cd20-4a72-90ea-65e58d99837b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:15.022169 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ddbdcf52-cd20-4a72-90ea-65e58d99837b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:15.168619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-ddbdcf52-cd20-4a72-90ea-65e58d99837b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:15.177191 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-ddbdcf52-cd20-4a72-90ea-65e58d99837b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 200 len: 1453 microversion: 2.1 time: 0.169457 Aug 31 12:33:15.177782 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 203/396] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:15 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:15.199778 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-3daaeb07-1c0d-43b7-aaf1-d546b0e9c23c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:15.200382 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-3daaeb07-1c0d-43b7-aaf1-d546b0e9c23c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:15.206999 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3daaeb07-1c0d-43b7-aaf1-d546b0e9c23c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:15.207493 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3daaeb07-1c0d-43b7-aaf1-d546b0e9c23c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:15.207952 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3daaeb07-1c0d-43b7-aaf1-d546b0e9c23c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:15.208652 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3daaeb07-1c0d-43b7-aaf1-d546b0e9c23c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:15.209108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3daaeb07-1c0d-43b7-aaf1-d546b0e9c23c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:15.209530 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3daaeb07-1c0d-43b7-aaf1-d546b0e9c23c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:15.392466 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-3daaeb07-1c0d-43b7-aaf1-d546b0e9c23c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:15.400370 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-3daaeb07-1c0d-43b7-aaf1-d546b0e9c23c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 200 len: 1453 microversion: 2.1 time: 0.205156 Aug 31 12:33:15.400936 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 194/397] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:15 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 1453 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:17.280642 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-493ae415-de32-4f13-94c3-b5f30aa9967b req-77ff42b7-baa6-4d0f-a1fc-96d4a0d20b21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "688b1262-46e9-4330-b633-05fc6a28cee3", "tag": "67e6c039-8531-4434-9617-4b63cd64bdce"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:33:17.291491 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-493ae415-de32-4f13-94c3-b5f30aa9967b req-77ff42b7-baa6-4d0f-a1fc-96d4a0d20b21 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:17.292186 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-493ae415-de32-4f13-94c3-b5f30aa9967b req-77ff42b7-baa6-4d0f-a1fc-96d4a0d20b21 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:17.292598 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-493ae415-de32-4f13-94c3-b5f30aa9967b req-77ff42b7-baa6-4d0f-a1fc-96d4a0d20b21 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:17.304205 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-493ae415-de32-4f13-94c3-b5f30aa9967b req-77ff42b7-baa6-4d0f-a1fc-96d4a0d20b21 service nova] Creating event network-changed:67e6c039-8531-4434-9617-4b63cd64bdce for instance 688b1262-46e9-4330-b633-05fc6a28cee3 on hv-cinder-85528 Aug 31 12:33:17.309669 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-493ae415-de32-4f13-94c3-b5f30aa9967b req-77ff42b7-baa6-4d0f-a1fc-96d4a0d20b21 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034193 Aug 31 12:33:17.310521 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 204/398] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:33:26.587155 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-ea8441cb-7ebf-489f-b6ea-1950e5aff366 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:26.587788 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-ea8441cb-7ebf-489f-b6ea-1950e5aff366 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:26.589941 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_api:SELECT=35 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:33:26.592424 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=30 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:33:26.597400 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ea8441cb-7ebf-489f-b6ea-1950e5aff366 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:26.597886 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ea8441cb-7ebf-489f-b6ea-1950e5aff366 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:26.598328 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ea8441cb-7ebf-489f-b6ea-1950e5aff366 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:26.599092 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ea8441cb-7ebf-489f-b6ea-1950e5aff366 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:26.599548 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ea8441cb-7ebf-489f-b6ea-1950e5aff366 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:26.599972 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ea8441cb-7ebf-489f-b6ea-1950e5aff366 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:26.744440 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.objects.instance [None req-ea8441cb-7ebf-489f-b6ea-1950e5aff366 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lazy-loading 'services' on Instance uuid 59de5135-bc13-4ecc-a3b9-015b32aec285 {{(pid=120750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:33:26.872010 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-ea8441cb-7ebf-489f-b6ea-1950e5aff366 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "DELETE /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285/os-volume_attachments/150c5871-234d-4c4f-8dac-23a8a07bfc4e" status: 202 len: 0 microversion: 2.1 time: 0.288729 Aug 31 12:33:26.873458 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 195/399] 10.222.0.79 () {58 vars in 1416 bytes} [Wed Aug 31 12:33:26 2022] DELETE /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285/os-volume_attachments/150c5871-234d-4c4f-8dac-23a8a07bfc4e => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:33:28.011836 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-3748d93c-a853-4c76-98d6-57f9fc98b4b1 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:33:28.014657 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_api:SELECT=29 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:33:28.015355 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=82 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:33:28.021473 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3748d93c-a853-4c76-98d6-57f9fc98b4b1 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:28.021960 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3748d93c-a853-4c76-98d6-57f9fc98b4b1 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:28.022397 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3748d93c-a853-4c76-98d6-57f9fc98b4b1 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:28.048194 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-3748d93c-a853-4c76-98d6-57f9fc98b4b1 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Going to try to stop instance {{(pid=120749) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 12:33:28.100847 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-3748d93c-a853-4c76-98d6-57f9fc98b4b1 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "POST /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285/action" status: 202 len: 0 microversion: 2.1 time: 0.093492 Aug 31 12:33:28.101902 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 205/400] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Aug 31 12:33:28 2022] POST /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 12:33:28.111625 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-fd0c79b5-aabd-4e09-9428-cd2943fce257 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:28.112493 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-fd0c79b5-aabd-4e09-9428-cd2943fce257 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:28.119261 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fd0c79b5-aabd-4e09-9428-cd2943fce257 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:28.119892 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fd0c79b5-aabd-4e09-9428-cd2943fce257 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:28.120634 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fd0c79b5-aabd-4e09-9428-cd2943fce257 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:28.121416 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fd0c79b5-aabd-4e09-9428-cd2943fce257 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:28.121818 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fd0c79b5-aabd-4e09-9428-cd2943fce257 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:28.122503 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fd0c79b5-aabd-4e09-9428-cd2943fce257 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:28.268118 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-fd0c79b5-aabd-4e09-9428-cd2943fce257 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:28.277641 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-fd0c79b5-aabd-4e09-9428-cd2943fce257 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1676 microversion: 2.1 time: 0.171126 Aug 31 12:33:28.278207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 196/401] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:28 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:33:29.300165 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-43c585db-bc1b-4f7c-895d-cd5509fdad0d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:29.300844 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-43c585db-bc1b-4f7c-895d-cd5509fdad0d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:29.307578 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-43c585db-bc1b-4f7c-895d-cd5509fdad0d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:29.308062 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-43c585db-bc1b-4f7c-895d-cd5509fdad0d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:29.308514 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-43c585db-bc1b-4f7c-895d-cd5509fdad0d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:29.309203 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-43c585db-bc1b-4f7c-895d-cd5509fdad0d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:29.309655 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-43c585db-bc1b-4f7c-895d-cd5509fdad0d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:29.310156 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-43c585db-bc1b-4f7c-895d-cd5509fdad0d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:29.663473 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-43c585db-bc1b-4f7c-895d-cd5509fdad0d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:29.672577 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-43c585db-bc1b-4f7c-895d-cd5509fdad0d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1676 microversion: 2.1 time: 0.376422 Aug 31 12:33:29.673232 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 206/402] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:29 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1676 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:30.388124 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-c658d85e-3ff6-4300-8699-5f3143781c6f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c1945ee-2958-41bc-ac34-4e44e5eb4f11"}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:33:30.390541 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-c658d85e-3ff6-4300-8699-5f3143781c6f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:30.396737 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c658d85e-3ff6-4300-8699-5f3143781c6f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:30.397212 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c658d85e-3ff6-4300-8699-5f3143781c6f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:30.397642 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c658d85e-3ff6-4300-8699-5f3143781c6f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:30.398392 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c658d85e-3ff6-4300-8699-5f3143781c6f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:30.398970 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c658d85e-3ff6-4300-8699-5f3143781c6f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:30.399435 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c658d85e-3ff6-4300-8699-5f3143781c6f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:30.663299 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-c658d85e-3ff6-4300-8699-5f3143781c6f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "POST /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279229 Aug 31 12:33:30.663907 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 197/403] 10.222.0.79 () {60 vars in 1323 bytes} [Wed Aug 31 12:33:30 2022] POST /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:33:30.693938 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-ae5971ba-6c68-4e6d-987f-32db48ee0faf tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:30.695132 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-ae5971ba-6c68-4e6d-987f-32db48ee0faf tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:30.701701 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ae5971ba-6c68-4e6d-987f-32db48ee0faf tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:30.702191 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ae5971ba-6c68-4e6d-987f-32db48ee0faf tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:30.702625 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ae5971ba-6c68-4e6d-987f-32db48ee0faf tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:30.703439 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ae5971ba-6c68-4e6d-987f-32db48ee0faf tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:30.703898 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ae5971ba-6c68-4e6d-987f-32db48ee0faf tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:30.704377 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ae5971ba-6c68-4e6d-987f-32db48ee0faf tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:30.846742 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-ae5971ba-6c68-4e6d-987f-32db48ee0faf tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:30.854470 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-ae5971ba-6c68-4e6d-987f-32db48ee0faf tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1676 microversion: 2.1 time: 0.164740 Aug 31 12:33:30.855057 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 207/404] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:30 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:31.878419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b421d776-df7a-4402-bbbe-d97ab87db034 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:31.879148 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-b421d776-df7a-4402-bbbe-d97ab87db034 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:31.885283 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b421d776-df7a-4402-bbbe-d97ab87db034 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:31.885770 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b421d776-df7a-4402-bbbe-d97ab87db034 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:31.886234 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b421d776-df7a-4402-bbbe-d97ab87db034 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:31.886952 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b421d776-df7a-4402-bbbe-d97ab87db034 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:31.887405 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b421d776-df7a-4402-bbbe-d97ab87db034 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:31.887830 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b421d776-df7a-4402-bbbe-d97ab87db034 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:32.017463 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b421d776-df7a-4402-bbbe-d97ab87db034 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:32.025547 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b421d776-df7a-4402-bbbe-d97ab87db034 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1676 microversion: 2.1 time: 0.152678 Aug 31 12:33:32.026112 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 198/405] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:31 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:33.048003 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-7775c6f2-bbc8-415c-9609-6539b298ed36 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:33.048647 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-7775c6f2-bbc8-415c-9609-6539b298ed36 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:33.055158 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7775c6f2-bbc8-415c-9609-6539b298ed36 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:33.055636 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7775c6f2-bbc8-415c-9609-6539b298ed36 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:33.056066 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7775c6f2-bbc8-415c-9609-6539b298ed36 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:33.056770 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7775c6f2-bbc8-415c-9609-6539b298ed36 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:33.057220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7775c6f2-bbc8-415c-9609-6539b298ed36 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:33.057638 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7775c6f2-bbc8-415c-9609-6539b298ed36 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:33.186649 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-7775c6f2-bbc8-415c-9609-6539b298ed36 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:33.194227 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-7775c6f2-bbc8-415c-9609-6539b298ed36 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1676 microversion: 2.1 time: 0.150431 Aug 31 12:33:33.194780 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 208/406] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:33 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:34.215531 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-5ae32d83-8eed-4c9b-bb5b-9b5ae33a241e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:34.216154 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-5ae32d83-8eed-4c9b-bb5b-9b5ae33a241e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:34.222658 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5ae32d83-8eed-4c9b-bb5b-9b5ae33a241e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:34.223167 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5ae32d83-8eed-4c9b-bb5b-9b5ae33a241e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:34.223595 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5ae32d83-8eed-4c9b-bb5b-9b5ae33a241e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:34.224276 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5ae32d83-8eed-4c9b-bb5b-9b5ae33a241e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:34.224723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5ae32d83-8eed-4c9b-bb5b-9b5ae33a241e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:34.225139 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5ae32d83-8eed-4c9b-bb5b-9b5ae33a241e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:34.356626 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-5ae32d83-8eed-4c9b-bb5b-9b5ae33a241e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:34.365380 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-5ae32d83-8eed-4c9b-bb5b-9b5ae33a241e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1676 microversion: 2.1 time: 0.153766 Aug 31 12:33:34.365976 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 199/407] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:34 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:35.386677 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-e109a31a-bc49-4f50-a18e-ad6b9bb177f0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:35.387278 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-e109a31a-bc49-4f50-a18e-ad6b9bb177f0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:35.394228 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e109a31a-bc49-4f50-a18e-ad6b9bb177f0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:35.394705 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e109a31a-bc49-4f50-a18e-ad6b9bb177f0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:35.395164 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e109a31a-bc49-4f50-a18e-ad6b9bb177f0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:35.395846 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e109a31a-bc49-4f50-a18e-ad6b9bb177f0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:35.396294 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e109a31a-bc49-4f50-a18e-ad6b9bb177f0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:35.396707 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e109a31a-bc49-4f50-a18e-ad6b9bb177f0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:35.527159 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-e109a31a-bc49-4f50-a18e-ad6b9bb177f0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:35.534803 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-e109a31a-bc49-4f50-a18e-ad6b9bb177f0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1676 microversion: 2.1 time: 0.151983 Aug 31 12:33:35.535389 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 209/408] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:35 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:36.557190 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-8057f16e-e9e8-4ddc-8835-9ec5ddb1d7dc tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:36.557844 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-8057f16e-e9e8-4ddc-8835-9ec5ddb1d7dc tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:36.565199 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8057f16e-e9e8-4ddc-8835-9ec5ddb1d7dc tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:36.565673 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8057f16e-e9e8-4ddc-8835-9ec5ddb1d7dc tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:36.566102 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8057f16e-e9e8-4ddc-8835-9ec5ddb1d7dc tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:36.566791 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8057f16e-e9e8-4ddc-8835-9ec5ddb1d7dc tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:36.567275 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8057f16e-e9e8-4ddc-8835-9ec5ddb1d7dc tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:36.567671 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8057f16e-e9e8-4ddc-8835-9ec5ddb1d7dc tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:36.707380 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-8057f16e-e9e8-4ddc-8835-9ec5ddb1d7dc tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:36.717034 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-8057f16e-e9e8-4ddc-8835-9ec5ddb1d7dc tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1676 microversion: 2.1 time: 0.164608 Aug 31 12:33:36.717617 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 200/409] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:36 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:37.741699 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-1a3554e8-3ae2-4c41-92a9-e9cb210ddbb8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:37.742306 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-1a3554e8-3ae2-4c41-92a9-e9cb210ddbb8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:37.748792 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1a3554e8-3ae2-4c41-92a9-e9cb210ddbb8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:37.750429 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1a3554e8-3ae2-4c41-92a9-e9cb210ddbb8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:37.750890 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1a3554e8-3ae2-4c41-92a9-e9cb210ddbb8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:37.751593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1a3554e8-3ae2-4c41-92a9-e9cb210ddbb8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:37.752039 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1a3554e8-3ae2-4c41-92a9-e9cb210ddbb8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:37.752455 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1a3554e8-3ae2-4c41-92a9-e9cb210ddbb8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:37.897055 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-1a3554e8-3ae2-4c41-92a9-e9cb210ddbb8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:37.906145 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-1a3554e8-3ae2-4c41-92a9-e9cb210ddbb8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1676 microversion: 2.1 time: 0.167936 Aug 31 12:33:37.907522 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 210/410] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:37 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:38.222682 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-9c724e1f-bc25-40fb-a008-109a2ada999e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:33:38.225198 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-9c724e1f-bc25-40fb-a008-109a2ada999e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:38.232182 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9c724e1f-bc25-40fb-a008-109a2ada999e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:38.232695 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9c724e1f-bc25-40fb-a008-109a2ada999e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:38.233111 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9c724e1f-bc25-40fb-a008-109a2ada999e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:38.234661 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9c724e1f-bc25-40fb-a008-109a2ada999e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:38.235279 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9c724e1f-bc25-40fb-a008-109a2ada999e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:38.235723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9c724e1f-bc25-40fb-a008-109a2ada999e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:38.261143 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.objects.instance [None req-9c724e1f-bc25-40fb-a008-109a2ada999e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lazy-loading 'flavor' on Instance uuid 247cb5f7-647e-4e39-8a71-99a980f3e7f6 {{(pid=120750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:33:38.401964 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-9c724e1f-bc25-40fb-a008-109a2ada999e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "POST /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6/action" status: 200 len: 32 microversion: 2.1 time: 0.183895 Aug 31 12:33:38.402801 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 201/411] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Aug 31 12:33:38 2022] POST /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6/action => generated 32 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 12:33:38.414220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-e289b003-0ccc-4700-b458-722f8a9e3131 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:38.414832 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-e289b003-0ccc-4700-b458-722f8a9e3131 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:38.422936 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e289b003-0ccc-4700-b458-722f8a9e3131 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:38.423793 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e289b003-0ccc-4700-b458-722f8a9e3131 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:38.424230 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e289b003-0ccc-4700-b458-722f8a9e3131 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:38.425044 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e289b003-0ccc-4700-b458-722f8a9e3131 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:38.425551 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e289b003-0ccc-4700-b458-722f8a9e3131 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:38.425989 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e289b003-0ccc-4700-b458-722f8a9e3131 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:38.602246 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-e289b003-0ccc-4700-b458-722f8a9e3131 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:38.618075 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-e289b003-0ccc-4700-b458-722f8a9e3131 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1735 microversion: 2.1 time: 0.207511 Aug 31 12:33:38.619326 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 211/412] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:38 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1735 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:38.929552 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-95afa4cf-b82b-4544-a7e7-0d9dafca3a92 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:38.930638 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-95afa4cf-b82b-4544-a7e7-0d9dafca3a92 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:38.938113 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-95afa4cf-b82b-4544-a7e7-0d9dafca3a92 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:38.938608 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-95afa4cf-b82b-4544-a7e7-0d9dafca3a92 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:38.939083 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-95afa4cf-b82b-4544-a7e7-0d9dafca3a92 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:38.939803 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-95afa4cf-b82b-4544-a7e7-0d9dafca3a92 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:38.940261 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-95afa4cf-b82b-4544-a7e7-0d9dafca3a92 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:38.940684 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-95afa4cf-b82b-4544-a7e7-0d9dafca3a92 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:39.092506 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-95afa4cf-b82b-4544-a7e7-0d9dafca3a92 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:39.102422 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-95afa4cf-b82b-4544-a7e7-0d9dafca3a92 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1653 microversion: 2.1 time: 0.177668 Aug 31 12:33:39.103110 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 202/413] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:38 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1653 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:39.135755 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-a3ddd9a3-6582-42a3-8828-9a43ffa0db73 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:33:39.143272 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a3ddd9a3-6582-42a3-8828-9a43ffa0db73 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:39.144052 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a3ddd9a3-6582-42a3-8828-9a43ffa0db73 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:39.144493 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a3ddd9a3-6582-42a3-8828-9a43ffa0db73 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:39.172114 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-a3ddd9a3-6582-42a3-8828-9a43ffa0db73 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Going to try to start instance {{(pid=120749) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 12:33:39.223951 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-a3ddd9a3-6582-42a3-8828-9a43ffa0db73 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "POST /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285/action" status: 202 len: 0 microversion: 2.1 time: 0.092235 Aug 31 12:33:39.224815 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 212/414] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Aug 31 12:33:39 2022] POST /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:33:39.241688 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-db670321-a2b8-43ac-883c-1321b03a52d9 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:39.242297 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-db670321-a2b8-43ac-883c-1321b03a52d9 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:39.252028 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-db670321-a2b8-43ac-883c-1321b03a52d9 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:39.252553 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-db670321-a2b8-43ac-883c-1321b03a52d9 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:39.252977 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-db670321-a2b8-43ac-883c-1321b03a52d9 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:39.253780 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-db670321-a2b8-43ac-883c-1321b03a52d9 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:39.254413 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-db670321-a2b8-43ac-883c-1321b03a52d9 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:39.255130 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-db670321-a2b8-43ac-883c-1321b03a52d9 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:39.643220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-c609b698-371d-4e7d-9c6b-1d66c948b968 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:39.644387 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-c609b698-371d-4e7d-9c6b-1d66c948b968 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:39.652810 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c609b698-371d-4e7d-9c6b-1d66c948b968 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:39.653618 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c609b698-371d-4e7d-9c6b-1d66c948b968 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:39.654494 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c609b698-371d-4e7d-9c6b-1d66c948b968 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:39.656089 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c609b698-371d-4e7d-9c6b-1d66c948b968 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:39.656489 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c609b698-371d-4e7d-9c6b-1d66c948b968 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:39.657036 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c609b698-371d-4e7d-9c6b-1d66c948b968 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:39.715847 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-db670321-a2b8-43ac-883c-1321b03a52d9 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:39.726428 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-db670321-a2b8-43ac-883c-1321b03a52d9 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1662 microversion: 2.1 time: 0.495632 Aug 31 12:33:39.727374 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 203/415] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:39 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1662 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:33:39.917609 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-c609b698-371d-4e7d-9c6b-1d66c948b968 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:39.927605 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-c609b698-371d-4e7d-9c6b-1d66c948b968 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1735 microversion: 2.1 time: 0.289471 Aug 31 12:33:39.928204 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 213/416] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:39 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1735 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:33:40.761874 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-e48e69f1-bd58-42a8-858c-a5efb83df175 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:40.762611 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-e48e69f1-bd58-42a8-858c-a5efb83df175 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:40.770531 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e48e69f1-bd58-42a8-858c-a5efb83df175 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:40.771062 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e48e69f1-bd58-42a8-858c-a5efb83df175 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:40.771495 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e48e69f1-bd58-42a8-858c-a5efb83df175 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:40.772200 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e48e69f1-bd58-42a8-858c-a5efb83df175 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:40.772880 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e48e69f1-bd58-42a8-858c-a5efb83df175 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:40.773339 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e48e69f1-bd58-42a8-858c-a5efb83df175 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:40.926476 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-e48e69f1-bd58-42a8-858c-a5efb83df175 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:40.940764 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-e48e69f1-bd58-42a8-858c-a5efb83df175 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1662 microversion: 2.1 time: 0.181739 Aug 31 12:33:40.942176 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 204/417] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:40 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1662 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:40.949740 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-18028d42-19a6-4ee1-850c-dba5e4e18a4b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:40.950459 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-18028d42-19a6-4ee1-850c-dba5e4e18a4b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:40.958660 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-18028d42-19a6-4ee1-850c-dba5e4e18a4b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:40.959342 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-18028d42-19a6-4ee1-850c-dba5e4e18a4b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:40.959934 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-18028d42-19a6-4ee1-850c-dba5e4e18a4b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:40.961001 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-18028d42-19a6-4ee1-850c-dba5e4e18a4b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:40.961610 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-18028d42-19a6-4ee1-850c-dba5e4e18a4b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:40.962346 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-18028d42-19a6-4ee1-850c-dba5e4e18a4b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:41.220105 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-18028d42-19a6-4ee1-850c-dba5e4e18a4b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:41.234967 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-18028d42-19a6-4ee1-850c-dba5e4e18a4b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1735 microversion: 2.1 time: 0.287879 Aug 31 12:33:41.236505 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 214/418] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:40 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1735 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:33:41.968614 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b8e4c250-db2a-49c2-9302-4c896fa46db6 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:41.969209 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-b8e4c250-db2a-49c2-9302-4c896fa46db6 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:41.975939 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8e4c250-db2a-49c2-9302-4c896fa46db6 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:41.976420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8e4c250-db2a-49c2-9302-4c896fa46db6 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:41.976856 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8e4c250-db2a-49c2-9302-4c896fa46db6 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:41.977549 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8e4c250-db2a-49c2-9302-4c896fa46db6 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:41.977997 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8e4c250-db2a-49c2-9302-4c896fa46db6 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:41.978413 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8e4c250-db2a-49c2-9302-4c896fa46db6 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:42.130116 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b8e4c250-db2a-49c2-9302-4c896fa46db6 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:42.138434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b8e4c250-db2a-49c2-9302-4c896fa46db6 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1666 microversion: 2.1 time: 0.173736 Aug 31 12:33:42.139048 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 205/419] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:41 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1666 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:42.269746 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-b87325eb-4103-438d-b0fc-6bc005689ac0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:42.270424 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-b87325eb-4103-438d-b0fc-6bc005689ac0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:42.277145 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b87325eb-4103-438d-b0fc-6bc005689ac0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:42.277638 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b87325eb-4103-438d-b0fc-6bc005689ac0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:42.278076 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b87325eb-4103-438d-b0fc-6bc005689ac0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:42.278800 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b87325eb-4103-438d-b0fc-6bc005689ac0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:42.279293 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b87325eb-4103-438d-b0fc-6bc005689ac0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:42.279715 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b87325eb-4103-438d-b0fc-6bc005689ac0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:42.450908 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-b87325eb-4103-438d-b0fc-6bc005689ac0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:42.465134 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-b87325eb-4103-438d-b0fc-6bc005689ac0 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1735 microversion: 2.1 time: 0.199120 Aug 31 12:33:42.466143 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 215/420] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:42 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:43.499138 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b44345a6-5db5-484f-904d-f63eeb472e28 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:43.500504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-b44345a6-5db5-484f-904d-f63eeb472e28 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:43.506519 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b44345a6-5db5-484f-904d-f63eeb472e28 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:43.507046 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b44345a6-5db5-484f-904d-f63eeb472e28 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:43.507478 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b44345a6-5db5-484f-904d-f63eeb472e28 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:43.508269 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b44345a6-5db5-484f-904d-f63eeb472e28 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:43.508929 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b44345a6-5db5-484f-904d-f63eeb472e28 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:43.509370 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b44345a6-5db5-484f-904d-f63eeb472e28 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:43.697614 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b44345a6-5db5-484f-904d-f63eeb472e28 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:43.713256 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b44345a6-5db5-484f-904d-f63eeb472e28 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1735 microversion: 2.1 time: 0.218344 Aug 31 12:33:43.714238 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 206/421] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:43 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1735 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:44.741407 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-3fcce323-8353-4851-ab76-06e46414dd5b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:44.742093 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-3fcce323-8353-4851-ab76-06e46414dd5b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:44.750029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3fcce323-8353-4851-ab76-06e46414dd5b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:44.750918 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3fcce323-8353-4851-ab76-06e46414dd5b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:44.751382 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3fcce323-8353-4851-ab76-06e46414dd5b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:44.752124 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3fcce323-8353-4851-ab76-06e46414dd5b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:44.752592 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3fcce323-8353-4851-ab76-06e46414dd5b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:44.753021 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3fcce323-8353-4851-ab76-06e46414dd5b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:44.908030 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-3fcce323-8353-4851-ab76-06e46414dd5b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:44.917451 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-3fcce323-8353-4851-ab76-06e46414dd5b tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1735 microversion: 2.1 time: 0.180220 Aug 31 12:33:44.918044 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 216/422] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:44 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:33:45.941374 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b95d4ca2-c432-4dc3-8bf0-27e728e2893f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:45.941978 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-b95d4ca2-c432-4dc3-8bf0-27e728e2893f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:45.953691 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b95d4ca2-c432-4dc3-8bf0-27e728e2893f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:45.954503 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b95d4ca2-c432-4dc3-8bf0-27e728e2893f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:45.955313 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b95d4ca2-c432-4dc3-8bf0-27e728e2893f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:45.956563 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b95d4ca2-c432-4dc3-8bf0-27e728e2893f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:45.957377 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b95d4ca2-c432-4dc3-8bf0-27e728e2893f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:45.958121 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b95d4ca2-c432-4dc3-8bf0-27e728e2893f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:45.981653 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:33:46.111643 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b95d4ca2-c432-4dc3-8bf0-27e728e2893f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:46.120412 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b95d4ca2-c432-4dc3-8bf0-27e728e2893f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1735 microversion: 2.1 time: 0.183698 Aug 31 12:33:46.121008 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 207/423] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:45 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:47.142677 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-671ddf28-0384-41b9-b937-8b146b7aafbe tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:47.143838 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-671ddf28-0384-41b9-b937-8b146b7aafbe tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:47.151989 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-671ddf28-0384-41b9-b937-8b146b7aafbe tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:47.152444 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-671ddf28-0384-41b9-b937-8b146b7aafbe tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:47.152892 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-671ddf28-0384-41b9-b937-8b146b7aafbe tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:47.153830 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-671ddf28-0384-41b9-b937-8b146b7aafbe tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:47.154673 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-671ddf28-0384-41b9-b937-8b146b7aafbe tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:47.155501 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-671ddf28-0384-41b9-b937-8b146b7aafbe tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:47.300679 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-671ddf28-0384-41b9-b937-8b146b7aafbe tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:47.309447 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-671ddf28-0384-41b9-b937-8b146b7aafbe tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1735 microversion: 2.1 time: 0.171111 Aug 31 12:33:47.310254 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 217/424] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:47 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:48.332862 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-874a7c0d-8fbf-4f0c-b480-1fc1e4b63518 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:48.333873 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-874a7c0d-8fbf-4f0c-b480-1fc1e4b63518 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:48.341414 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-874a7c0d-8fbf-4f0c-b480-1fc1e4b63518 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:48.341913 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-874a7c0d-8fbf-4f0c-b480-1fc1e4b63518 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:48.342339 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-874a7c0d-8fbf-4f0c-b480-1fc1e4b63518 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:48.343617 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-874a7c0d-8fbf-4f0c-b480-1fc1e4b63518 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:48.344077 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-874a7c0d-8fbf-4f0c-b480-1fc1e4b63518 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:48.344674 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-874a7c0d-8fbf-4f0c-b480-1fc1e4b63518 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:48.493852 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-874a7c0d-8fbf-4f0c-b480-1fc1e4b63518 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:48.502950 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-874a7c0d-8fbf-4f0c-b480-1fc1e4b63518 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1735 microversion: 2.1 time: 0.175395 Aug 31 12:33:48.503575 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 208/425] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:48 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:49.532292 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-a8e8a2bb-076f-4842-8c2e-d8d1746a64d9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:49.532906 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-a8e8a2bb-076f-4842-8c2e-d8d1746a64d9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:49.539552 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a8e8a2bb-076f-4842-8c2e-d8d1746a64d9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:49.540051 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a8e8a2bb-076f-4842-8c2e-d8d1746a64d9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:49.540488 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a8e8a2bb-076f-4842-8c2e-d8d1746a64d9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:49.541198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a8e8a2bb-076f-4842-8c2e-d8d1746a64d9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:49.541653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a8e8a2bb-076f-4842-8c2e-d8d1746a64d9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:49.542077 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a8e8a2bb-076f-4842-8c2e-d8d1746a64d9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:49.698764 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-a8e8a2bb-076f-4842-8c2e-d8d1746a64d9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:49.708993 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-a8e8a2bb-076f-4842-8c2e-d8d1746a64d9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1735 microversion: 2.1 time: 0.181731 Aug 31 12:33:49.709870 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 218/426] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:49 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:50.731229 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-f295ec8c-1d54-46d1-a716-0f1d94b4a37a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:50.731774 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-f295ec8c-1d54-46d1-a716-0f1d94b4a37a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:50.739259 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f295ec8c-1d54-46d1-a716-0f1d94b4a37a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:50.739750 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f295ec8c-1d54-46d1-a716-0f1d94b4a37a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:50.740189 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f295ec8c-1d54-46d1-a716-0f1d94b4a37a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:50.740886 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f295ec8c-1d54-46d1-a716-0f1d94b4a37a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:50.741341 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f295ec8c-1d54-46d1-a716-0f1d94b4a37a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:50.741766 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f295ec8c-1d54-46d1-a716-0f1d94b4a37a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:50.878769 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f295ec8c-1d54-46d1-a716-0f1d94b4a37a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:50.887330 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-f295ec8c-1d54-46d1-a716-0f1d94b4a37a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1735 microversion: 2.1 time: 0.160015 Aug 31 12:33:50.888029 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 209/427] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:50 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:51.910301 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-6e046ffe-fba0-432c-af87-4034af5cc2d9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:51.911053 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-6e046ffe-fba0-432c-af87-4034af5cc2d9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:51.919625 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6e046ffe-fba0-432c-af87-4034af5cc2d9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:51.920128 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6e046ffe-fba0-432c-af87-4034af5cc2d9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:51.920597 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6e046ffe-fba0-432c-af87-4034af5cc2d9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:51.921328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6e046ffe-fba0-432c-af87-4034af5cc2d9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:51.921811 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6e046ffe-fba0-432c-af87-4034af5cc2d9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:51.922205 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6e046ffe-fba0-432c-af87-4034af5cc2d9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:51.944045 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:33:52.068231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-6e046ffe-fba0-432c-af87-4034af5cc2d9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:52.076897 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-6e046ffe-fba0-432c-af87-4034af5cc2d9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1735 microversion: 2.1 time: 0.171252 Aug 31 12:33:52.077503 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 219/428] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:51 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:53.098079 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-d4713f8c-0cab-45d5-b146-274e4ebf7c4a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:53.098983 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-d4713f8c-0cab-45d5-b146-274e4ebf7c4a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:53.105488 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d4713f8c-0cab-45d5-b146-274e4ebf7c4a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:53.105978 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d4713f8c-0cab-45d5-b146-274e4ebf7c4a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:53.106410 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d4713f8c-0cab-45d5-b146-274e4ebf7c4a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:53.107148 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d4713f8c-0cab-45d5-b146-274e4ebf7c4a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:53.107600 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d4713f8c-0cab-45d5-b146-274e4ebf7c4a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:53.108025 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d4713f8c-0cab-45d5-b146-274e4ebf7c4a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:53.244362 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-d4713f8c-0cab-45d5-b146-274e4ebf7c4a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:53.254682 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-d4713f8c-0cab-45d5-b146-274e4ebf7c4a tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1735 microversion: 2.1 time: 0.160431 Aug 31 12:33:53.255327 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 210/429] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:53 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:53.541840 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-e9041194-2777-4fa7-b926-cd3e39ea706c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:53.542444 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-e9041194-2777-4fa7-b926-cd3e39ea706c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:53.548955 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e9041194-2777-4fa7-b926-cd3e39ea706c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:53.549438 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e9041194-2777-4fa7-b926-cd3e39ea706c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:53.549921 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e9041194-2777-4fa7-b926-cd3e39ea706c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:53.550598 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e9041194-2777-4fa7-b926-cd3e39ea706c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:53.551090 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e9041194-2777-4fa7-b926-cd3e39ea706c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:53.551495 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e9041194-2777-4fa7-b926-cd3e39ea706c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:53.585562 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-e9041194-2777-4fa7-b926-cd3e39ea706c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8/os-volume_attachments/e8b03d3a-6f7e-4312-a773-c3292af64d14" status: 200 len: 194 microversion: 2.20 time: 0.047675 Aug 31 12:33:53.586150 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 220/430] 10.222.0.79 () {60 vars in 1454 bytes} [Wed Aug 31 12:33:53 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8/os-volume_attachments/e8b03d3a-6f7e-4312-a773-c3292af64d14 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:33:53.656221 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b769769f-be32-4c82-977f-a263f1c0bc9a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:53.656702 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-b769769f-be32-4c82-977f-a263f1c0bc9a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:53.662704 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b769769f-be32-4c82-977f-a263f1c0bc9a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:53.663212 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b769769f-be32-4c82-977f-a263f1c0bc9a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:53.663647 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b769769f-be32-4c82-977f-a263f1c0bc9a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:53.664330 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b769769f-be32-4c82-977f-a263f1c0bc9a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:53.664780 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b769769f-be32-4c82-977f-a263f1c0bc9a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:53.665196 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b769769f-be32-4c82-977f-a263f1c0bc9a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:53.750385 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.objects.instance [None req-b769769f-be32-4c82-977f-a263f1c0bc9a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lazy-loading 'services' on Instance uuid 34ecec01-dd25-474d-addd-1d9b8de152b8 {{(pid=120750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:33:53.825605 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b769769f-be32-4c82-977f-a263f1c0bc9a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "DELETE /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8/os-volume_attachments/e8b03d3a-6f7e-4312-a773-c3292af64d14" status: 202 len: 0 microversion: 2.20 time: 0.173210 Aug 31 12:33:53.826263 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 211/431] 10.222.0.79 () {60 vars in 1457 bytes} [Wed Aug 31 12:33:53 2022] DELETE /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8/os-volume_attachments/e8b03d3a-6f7e-4312-a773-c3292af64d14 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:33:53.834693 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-2b93b9d2-1430-4826-ad2f-9819182f29f1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:53.836958 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-2b93b9d2-1430-4826-ad2f-9819182f29f1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:53.842918 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2b93b9d2-1430-4826-ad2f-9819182f29f1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:53.843550 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2b93b9d2-1430-4826-ad2f-9819182f29f1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:53.843980 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2b93b9d2-1430-4826-ad2f-9819182f29f1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:53.844686 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2b93b9d2-1430-4826-ad2f-9819182f29f1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:53.845239 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2b93b9d2-1430-4826-ad2f-9819182f29f1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:53.845759 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2b93b9d2-1430-4826-ad2f-9819182f29f1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:53.878134 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-2b93b9d2-1430-4826-ad2f-9819182f29f1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047390 Aug 31 12:33:53.878684 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 221/432] 10.222.0.79 () {60 vars in 1343 bytes} [Wed Aug 31 12:33:53 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:33:54.278191 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-de4668a8-0ed1-4da3-9357-60e74782b5da tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:54.278902 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-de4668a8-0ed1-4da3-9357-60e74782b5da tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:54.286599 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-de4668a8-0ed1-4da3-9357-60e74782b5da tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:54.287120 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-de4668a8-0ed1-4da3-9357-60e74782b5da tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:54.287555 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-de4668a8-0ed1-4da3-9357-60e74782b5da tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:54.288248 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-de4668a8-0ed1-4da3-9357-60e74782b5da tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:54.288696 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-de4668a8-0ed1-4da3-9357-60e74782b5da tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:54.289116 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-de4668a8-0ed1-4da3-9357-60e74782b5da tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:54.449700 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-de4668a8-0ed1-4da3-9357-60e74782b5da tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:54.459567 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-de4668a8-0ed1-4da3-9357-60e74782b5da tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1735 microversion: 2.1 time: 0.185982 Aug 31 12:33:54.460151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 212/433] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:54 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:54.890881 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-9e459b0e-0950-4dd4-9182-a4717b540674 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:54.893097 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-9e459b0e-0950-4dd4-9182-a4717b540674 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:54.899906 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9e459b0e-0950-4dd4-9182-a4717b540674 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:54.900390 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9e459b0e-0950-4dd4-9182-a4717b540674 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:54.900820 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9e459b0e-0950-4dd4-9182-a4717b540674 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:54.901510 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9e459b0e-0950-4dd4-9182-a4717b540674 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:54.901955 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9e459b0e-0950-4dd4-9182-a4717b540674 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:54.902371 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9e459b0e-0950-4dd4-9182-a4717b540674 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:54.934640 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-9e459b0e-0950-4dd4-9182-a4717b540674 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047618 Aug 31 12:33:54.935264 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 222/434] 10.222.0.79 () {60 vars in 1343 bytes} [Wed Aug 31 12:33:54 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:33:55.006030 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-4917ec48-cc5b-4477-801c-955083953547 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:55.006526 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-4917ec48-cc5b-4477-801c-955083953547 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:55.012574 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4917ec48-cc5b-4477-801c-955083953547 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:55.013161 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4917ec48-cc5b-4477-801c-955083953547 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:55.013676 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4917ec48-cc5b-4477-801c-955083953547 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:55.014425 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4917ec48-cc5b-4477-801c-955083953547 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:55.015029 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4917ec48-cc5b-4477-801c-955083953547 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:55.015498 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4917ec48-cc5b-4477-801c-955083953547 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:55.042131 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-4917ec48-cc5b-4477-801c-955083953547 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Going to try to terminate instance {{(pid=120750) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:33:55.122937 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-4917ec48-cc5b-4477-801c-955083953547 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "DELETE /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 204 len: 0 microversion: 2.20 time: 0.120376 Aug 31 12:33:55.123587 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 213/435] 10.222.0.79 () {60 vars in 1280 bytes} [Wed Aug 31 12:33:55 2022] DELETE /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 12:33:55.133698 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-63ca3f72-670a-405b-ae80-e445b88c8d2b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:55.134314 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-63ca3f72-670a-405b-ae80-e445b88c8d2b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:55.141104 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-63ca3f72-670a-405b-ae80-e445b88c8d2b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:55.141525 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-63ca3f72-670a-405b-ae80-e445b88c8d2b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:55.141953 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-63ca3f72-670a-405b-ae80-e445b88c8d2b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:55.142629 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-63ca3f72-670a-405b-ae80-e445b88c8d2b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:55.143104 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-63ca3f72-670a-405b-ae80-e445b88c8d2b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:55.143520 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-63ca3f72-670a-405b-ae80-e445b88c8d2b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:55.287375 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-63ca3f72-670a-405b-ae80-e445b88c8d2b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:55.295467 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-63ca3f72-670a-405b-ae80-e445b88c8d2b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:55.297445 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-63ca3f72-670a-405b-ae80-e445b88c8d2b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:55.298580 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-63ca3f72-670a-405b-ae80-e445b88c8d2b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1724 microversion: 2.20 time: 0.169968 Aug 31 12:33:55.299171 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 223/436] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:33:55 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:33:55.482143 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-bac42874-18b5-4ee4-8927-33c21c3dfbba tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:55.482789 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-bac42874-18b5-4ee4-8927-33c21c3dfbba tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:55.490200 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bac42874-18b5-4ee4-8927-33c21c3dfbba tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:55.490673 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bac42874-18b5-4ee4-8927-33c21c3dfbba tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:55.491146 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bac42874-18b5-4ee4-8927-33c21c3dfbba tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:55.491828 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bac42874-18b5-4ee4-8927-33c21c3dfbba tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:55.492271 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bac42874-18b5-4ee4-8927-33c21c3dfbba tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:55.492686 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bac42874-18b5-4ee4-8927-33c21c3dfbba tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:55.633933 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-bac42874-18b5-4ee4-8927-33c21c3dfbba tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:55.643854 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-bac42874-18b5-4ee4-8927-33c21c3dfbba tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1735 microversion: 2.1 time: 0.165879 Aug 31 12:33:55.644441 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 214/437] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:55 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:56.321909 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-e9fb1b5b-7db6-4071-b5fb-2af5173440d1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:56.322581 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-e9fb1b5b-7db6-4071-b5fb-2af5173440d1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:56.330004 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e9fb1b5b-7db6-4071-b5fb-2af5173440d1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:56.330487 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e9fb1b5b-7db6-4071-b5fb-2af5173440d1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:56.330949 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e9fb1b5b-7db6-4071-b5fb-2af5173440d1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:56.331739 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e9fb1b5b-7db6-4071-b5fb-2af5173440d1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:56.332211 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e9fb1b5b-7db6-4071-b5fb-2af5173440d1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:56.332627 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e9fb1b5b-7db6-4071-b5fb-2af5173440d1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:56.475251 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-e9fb1b5b-7db6-4071-b5fb-2af5173440d1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:56.484975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-e9fb1b5b-7db6-4071-b5fb-2af5173440d1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:56.486564 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-e9fb1b5b-7db6-4071-b5fb-2af5173440d1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:56.487780 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-e9fb1b5b-7db6-4071-b5fb-2af5173440d1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1724 microversion: 2.20 time: 0.169817 Aug 31 12:33:56.488337 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 224/438] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:33:56 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:33:56.665761 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-4364a1ca-0d95-45e4-97a1-18363f03f5d3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:56.666325 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-4364a1ca-0d95-45e4-97a1-18363f03f5d3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:56.668757 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:33:56.674834 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4364a1ca-0d95-45e4-97a1-18363f03f5d3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:56.675353 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4364a1ca-0d95-45e4-97a1-18363f03f5d3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:56.675790 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4364a1ca-0d95-45e4-97a1-18363f03f5d3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:56.676495 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4364a1ca-0d95-45e4-97a1-18363f03f5d3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:56.676955 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4364a1ca-0d95-45e4-97a1-18363f03f5d3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:56.677373 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4364a1ca-0d95-45e4-97a1-18363f03f5d3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:56.826371 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-4364a1ca-0d95-45e4-97a1-18363f03f5d3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:56.838472 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-4364a1ca-0d95-45e4-97a1-18363f03f5d3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1735 microversion: 2.1 time: 0.176534 Aug 31 12:33:56.839417 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 215/439] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:56 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:57.513641 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-326e3144-a513-4bcd-b9ee-0f9c04aa574d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:57.518570 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-326e3144-a513-4bcd-b9ee-0f9c04aa574d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:57.528450 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-326e3144-a513-4bcd-b9ee-0f9c04aa574d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:57.528957 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-326e3144-a513-4bcd-b9ee-0f9c04aa574d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:57.529550 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-326e3144-a513-4bcd-b9ee-0f9c04aa574d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:57.530651 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-326e3144-a513-4bcd-b9ee-0f9c04aa574d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:57.531152 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-326e3144-a513-4bcd-b9ee-0f9c04aa574d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:57.531580 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-326e3144-a513-4bcd-b9ee-0f9c04aa574d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:57.653750 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-326e3144-a513-4bcd-b9ee-0f9c04aa574d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:57.674736 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-326e3144-a513-4bcd-b9ee-0f9c04aa574d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:57.678695 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-326e3144-a513-4bcd-b9ee-0f9c04aa574d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:57.680898 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-326e3144-a513-4bcd-b9ee-0f9c04aa574d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1656 microversion: 2.20 time: 0.172627 Aug 31 12:33:57.681879 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 225/440] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:33:57 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1656 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:33:57.872030 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-1bcba20a-3835-4c01-808a-8f6f1beaebdc tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:57.873229 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-1bcba20a-3835-4c01-808a-8f6f1beaebdc tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:57.880756 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1bcba20a-3835-4c01-808a-8f6f1beaebdc tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:57.881532 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1bcba20a-3835-4c01-808a-8f6f1beaebdc tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:57.882146 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1bcba20a-3835-4c01-808a-8f6f1beaebdc tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:57.883072 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1bcba20a-3835-4c01-808a-8f6f1beaebdc tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:57.883697 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1bcba20a-3835-4c01-808a-8f6f1beaebdc tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:57.884117 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1bcba20a-3835-4c01-808a-8f6f1beaebdc tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:58.008384 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-eae92d3b-0649-4586-b500-64a12b0923dc req-11dbd539-dddd-456e-9743-4f29282b8b0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34ecec01-dd25-474d-addd-1d9b8de152b8", "name": "network-vif-deleted", "tag": "da6f3218-a171-4509-bd68-c737a3ff6eaf"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:33:58.036320 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_api:SELECT=43 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:33:58.039062 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-eae92d3b-0649-4586-b500-64a12b0923dc req-11dbd539-dddd-456e-9743-4f29282b8b0c service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:58.039701 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-eae92d3b-0649-4586-b500-64a12b0923dc req-11dbd539-dddd-456e-9743-4f29282b8b0c service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:58.040230 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-eae92d3b-0649-4586-b500-64a12b0923dc req-11dbd539-dddd-456e-9743-4f29282b8b0c service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:58.058405 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-eae92d3b-0649-4586-b500-64a12b0923dc req-11dbd539-dddd-456e-9743-4f29282b8b0c service nova] Creating event network-vif-deleted:da6f3218-a171-4509-bd68-c737a3ff6eaf for instance 34ecec01-dd25-474d-addd-1d9b8de152b8 on hv-cinder-85528 Aug 31 12:33:58.066312 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-eae92d3b-0649-4586-b500-64a12b0923dc req-11dbd539-dddd-456e-9743-4f29282b8b0c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061687 Aug 31 12:33:58.068452 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 226/441] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:33:58.082798 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-1bcba20a-3835-4c01-808a-8f6f1beaebdc tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:58.097716 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-1bcba20a-3835-4c01-808a-8f6f1beaebdc tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1735 microversion: 2.1 time: 0.229332 Aug 31 12:33:58.099139 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 216/442] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:57 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1735 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:58.708471 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-73e4d9a8-1f19-422c-8aa9-e04df4de453c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:58.709234 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-73e4d9a8-1f19-422c-8aa9-e04df4de453c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:58.721689 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-73e4d9a8-1f19-422c-8aa9-e04df4de453c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:58.722759 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-73e4d9a8-1f19-422c-8aa9-e04df4de453c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:58.723839 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-73e4d9a8-1f19-422c-8aa9-e04df4de453c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:58.725189 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-73e4d9a8-1f19-422c-8aa9-e04df4de453c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:58.726103 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-73e4d9a8-1f19-422c-8aa9-e04df4de453c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:58.726972 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-73e4d9a8-1f19-422c-8aa9-e04df4de453c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:58.769124 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-73e4d9a8-1f19-422c-8aa9-e04df4de453c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:58.771796 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-73e4d9a8-1f19-422c-8aa9-e04df4de453c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:58.772653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-73e4d9a8-1f19-422c-8aa9-e04df4de453c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:58.773199 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.objects.instance [None req-73e4d9a8-1f19-422c-8aa9-e04df4de453c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lazy-loading 'fault' on Instance uuid 34ecec01-dd25-474d-addd-1d9b8de152b8 {{(pid=120749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:33:58.837062 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-73e4d9a8-1f19-422c-8aa9-e04df4de453c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:58.848253 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-73e4d9a8-1f19-422c-8aa9-e04df4de453c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:58.850254 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-73e4d9a8-1f19-422c-8aa9-e04df4de453c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:58.851593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-73e4d9a8-1f19-422c-8aa9-e04df4de453c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 200 len: 1372 microversion: 2.20 time: 0.149300 Aug 31 12:33:58.852539 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 227/443] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:33:58 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:33:59.137263 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-e7e6517a-5016-4296-aead-6e50572032c5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:59.139182 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-e7e6517a-5016-4296-aead-6e50572032c5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:59.147819 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e7e6517a-5016-4296-aead-6e50572032c5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:59.148408 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e7e6517a-5016-4296-aead-6e50572032c5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:59.148934 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e7e6517a-5016-4296-aead-6e50572032c5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:59.149745 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e7e6517a-5016-4296-aead-6e50572032c5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:59.150205 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e7e6517a-5016-4296-aead-6e50572032c5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:59.150631 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e7e6517a-5016-4296-aead-6e50572032c5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:59.307638 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-e7e6517a-5016-4296-aead-6e50572032c5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:33:59.316912 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-e7e6517a-5016-4296-aead-6e50572032c5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1735 microversion: 2.1 time: 0.185659 Aug 31 12:33:59.318533 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 217/444] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:33:59 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:33:59.879900 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-6867d38e-259f-4495-83d7-bee5d4feee97 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:59.880496 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-6867d38e-259f-4495-83d7-bee5d4feee97 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:33:59.887409 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6867d38e-259f-4495-83d7-bee5d4feee97 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:59.887898 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6867d38e-259f-4495-83d7-bee5d4feee97 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:59.888331 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6867d38e-259f-4495-83d7-bee5d4feee97 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:59.889039 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6867d38e-259f-4495-83d7-bee5d4feee97 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:33:59.889487 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6867d38e-259f-4495-83d7-bee5d4feee97 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:33:59.890426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6867d38e-259f-4495-83d7-bee5d4feee97 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:33:59.907300 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.wsgi [None req-6867d38e-259f-4495-83d7-bee5d4feee97 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] HTTP exception thrown: Instance 34ecec01-dd25-474d-addd-1d9b8de152b8 could not be found. Aug 31 12:33:59.908992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-6867d38e-259f-4495-83d7-bee5d4feee97 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Request method failure captured: Aug 31 12:33:59.908992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: request: GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 HTTP/1.1 Aug 31 12:33:59.908992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept: application/json Aug 31 12:33:59.908992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept-Encoding: identity Aug 31 12:33:59.908992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Connection: close Aug 31 12:33:59.908992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Length: 0 Aug 31 12:33:59.908992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Type: application/json Aug 31 12:33:59.908992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Host: 10.222.0.79 Aug 31 12:33:59.908992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Openstack-System-Scope: None Aug 31 12:33:59.908992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: User-Agent: python-urllib3/1.26.12 Aug 31 12:33:59.908992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Auth-Token: gAAAAABjD1Q8_fKXu_7R_QGxQKTF7lFiWyT2RAjzIuVPjIM9dyfrljx1xlXnC7qwTfL8uoCLrmDxjoUAGbKrZ1-as7HlKH9zn8Ie9RnJFoQuIgtxkzodw4_WMQMiOoe7YSrL8r3gdFv9pH5SeNHNJOZzft1oVZcsjzrhUw3REkSM22eu5KLeZ3w Aug 31 12:33:59.908992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Id: None Aug 31 12:33:59.908992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Name: None Aug 31 12:33:59.908992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Identity-Status: Confirmed Aug 31 12:33:59.908992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Is-Admin-Project: True Aug 31 12:33:59.908992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 12:33:59.908992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Id: default Aug 31 12:33:59.908992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Name: Default Aug 31 12:33:59.908992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Id: 93d78bffa2c740b1aa7e09882a90eb9a Aug 31 12:33:59.908992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1598873957 Aug 31 12:33:59.908992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Role: reader,member Aug 31 12:33:59.908992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Roles: reader,member Aug 31 12:33:59.914767 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/93d78bffa2c740b1aa7e09882a90eb9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_93d78bffa2c740b1aa7e09882a90eb9a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/93d78bffa2c740b1aa7e09882a90eb9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/93d78bffa2c740b1aa7e09882a90eb9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:33:59.914767 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1598873957 Aug 31 12:33:59.914767 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Id: 93d78bffa2c740b1aa7e09882a90eb9a Aug 31 12:33:59.914767 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1598873957 Aug 31 12:33:59.914767 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User: tempest-AttachVolumeShelveTestJSON-1598873957-project Aug 31 12:33:59.914767 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Id: default Aug 31 12:33:59.914767 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Name: Default Aug 31 12:33:59.914767 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Id: ee19faf2a2c54b19a9dc01d28f045b3a Aug 31 12:33:59.914767 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1598873957-project Aug 31 12:33:59.914767 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: method: > Aug 31 12:33:59.914767 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: exception: Instance 34ecec01-dd25-474d-addd-1d9b8de152b8 could not be found. Aug 31 12:33:59.914767 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: action_args: {'id': '34ecec01-dd25-474d-addd-1d9b8de152b8'} Aug 31 12:33:59.915836 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:33:59.915836 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:33:59.915836 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:33:59.915836 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:33:59.915836 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:33:59.915836 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:33:59.915836 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:33:59.915836 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:33:59.915836 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:33:59.915836 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:33:59.915836 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34ecec01-dd25-474d-addd-1d9b8de152b8 could not be found. Aug 31 12:33:59.915836 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:33:59.915836 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:33:59.915836 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:33:59.915836 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:33:59.915836 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:33:59.915836 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:33:59.915836 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:33:59.915836 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:33:59.915836 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:33:59.917454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:33:59.917454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:33:59.917454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:33:59.917454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:33:59.917454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:33:59.917454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:33:59.917454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:33:59.917454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34ecec01-dd25-474d-addd-1d9b8de152b8 could not be found. Aug 31 12:33:59.917454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:33:59.917454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:33:59.917454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:33:59.917454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:33:59.917454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:33:59.917454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:33:59.917454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:33:59.917454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:33:59.917454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34ecec01-dd25-474d-addd-1d9b8de152b8 could not be found. Aug 31 12:33:59.917454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:33:59.918895 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-6867d38e-259f-4495-83d7-bee5d4feee97 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Returning 404 to user: Instance 34ecec01-dd25-474d-addd-1d9b8de152b8 could not be found. {{(pid=120749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:33:59.918895 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-6867d38e-259f-4495-83d7-bee5d4feee97 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 404 len: 111 microversion: 2.20 time: 0.034392 Aug 31 12:33:59.918895 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 228/445] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:33:59 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 12:33:59.920237 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-f21a0822-dc9c-4939-8485-b43a354c771a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '.version_select at 0x7f8d17150b80>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:33:59.943117 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-f21a0822-dc9c-4939-8485-b43a354c771a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1511353979" status: 204 len: 0 microversion: 2.20 time: 0.026902 Aug 31 12:33:59.943712 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 218/446] 10.222.0.79 () {60 vars in 1262 bytes} [Wed Aug 31 12:33:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1511353979 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 12:34:00.339427 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-c4a7d1c1-0fc7-41b9-9c55-5f3ab588d004 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:00.340036 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-c4a7d1c1-0fc7-41b9-9c55-5f3ab588d004 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:00.346591 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c4a7d1c1-0fc7-41b9-9c55-5f3ab588d004 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:00.347134 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c4a7d1c1-0fc7-41b9-9c55-5f3ab588d004 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:00.347565 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c4a7d1c1-0fc7-41b9-9c55-5f3ab588d004 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:00.348260 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c4a7d1c1-0fc7-41b9-9c55-5f3ab588d004 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:00.348708 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c4a7d1c1-0fc7-41b9-9c55-5f3ab588d004 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:00.349129 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c4a7d1c1-0fc7-41b9-9c55-5f3ab588d004 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:00.490972 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-c4a7d1c1-0fc7-41b9-9c55-5f3ab588d004 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:00.501299 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-c4a7d1c1-0fc7-41b9-9c55-5f3ab588d004 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1735 microversion: 2.1 time: 0.165626 Aug 31 12:34:00.501880 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 229/447] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:00 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:34:00.635943 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-2ea4cfd6-a1ba-44c3-9bc5-af564922ed1b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Action: 'create', calling method: .version_select at 0x7f8d1714a4c0>, body: {"keypair": {"name": "tempest-keypair-627371339", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTcWSa3ZczdV7EZ6MMTSwNHyxvzGEnoy7emJMJMQwnPeKahdD2R8yiUn8ejr7WROvVRgyZUjr9FYk4sV6KGanQ2n2CRWnrsIyJhL8YTDknEUQDNtAHhi13FXChETxAcIw=="}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:34:00.653512 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-2ea4cfd6-a1ba-44c3-9bc5-af564922ed1b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Getting quotas for project 93d78bffa2c740b1aa7e09882a90eb9a. Resources: {'key_pairs'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:34:00.657909 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-2ea4cfd6-a1ba-44c3-9bc5-af564922ed1b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Getting quotas for user ee19faf2a2c54b19a9dc01d28f045b3a and project 93d78bffa2c740b1aa7e09882a90eb9a. Resources: {'key_pairs'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:34:00.687734 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-2ea4cfd6-a1ba-44c3-9bc5-af564922ed1b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.056378 Aug 31 12:34:00.688351 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 219/448] 10.222.0.79 () {62 vars in 1200 bytes} [Wed Aug 31 12:34:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 12:34:01.523586 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-e01d907f-50b5-4f62-a6ae-78b9e6116f10 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:01.524608 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-e01d907f-50b5-4f62-a6ae-78b9e6116f10 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:01.532644 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e01d907f-50b5-4f62-a6ae-78b9e6116f10 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:01.533285 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e01d907f-50b5-4f62-a6ae-78b9e6116f10 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:01.533687 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e01d907f-50b5-4f62-a6ae-78b9e6116f10 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:01.534547 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e01d907f-50b5-4f62-a6ae-78b9e6116f10 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:01.535341 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e01d907f-50b5-4f62-a6ae-78b9e6116f10 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:01.535893 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e01d907f-50b5-4f62-a6ae-78b9e6116f10 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:01.689046 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-e01d907f-50b5-4f62-a6ae-78b9e6116f10 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:01.697792 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-e01d907f-50b5-4f62-a6ae-78b9e6116f10 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1735 microversion: 2.1 time: 0.178256 Aug 31 12:34:01.698365 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 230/449] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:01 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:34:02.104801 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-5e881e7a-68e6-4471-996f-9c74dd66cd99 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-962156184", "imageRef": "2aaf4ebd-395b-468e-bb6b-c663d01edea0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fd88f8d0-f886-493c-9800-db0ea697ebf3"}], "security_groups": [{"name": "tempest-securitygroup--1352850893"}], "key_name": "tempest-keypair-627371339", "user_data": "}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:34:02.213856 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.network.neutron [None req-5e881e7a-68e6-4471-996f-9c74dd66cd99 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] validate_networks() for [('fd88f8d0-f886-493c-9800-db0ea697ebf3', None, None, None, None, None)] {{(pid=120750) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:34:02.585922 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-5e881e7a-68e6-4471-996f-9c74dd66cd99 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Flavor limits 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:34:02.586346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-5e881e7a-68e6-4471-996f-9c74dd66cd99 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Image limits 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:34:02.586816 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-5e881e7a-68e6-4471-996f-9c74dd66cd99 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Flavor pref 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:34:02.587271 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-5e881e7a-68e6-4471-996f-9c74dd66cd99 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Image pref 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:34:02.587700 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-5e881e7a-68e6-4471-996f-9c74dd66cd99 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:34:02.597159 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5e881e7a-68e6-4471-996f-9c74dd66cd99 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:02.597643 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5e881e7a-68e6-4471-996f-9c74dd66cd99 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:02.598075 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5e881e7a-68e6-4471-996f-9c74dd66cd99 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:02.598800 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5e881e7a-68e6-4471-996f-9c74dd66cd99 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:02.599284 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5e881e7a-68e6-4471-996f-9c74dd66cd99 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:02.599704 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5e881e7a-68e6-4471-996f-9c74dd66cd99 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:02.617593 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-5e881e7a-68e6-4471-996f-9c74dd66cd99 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Getting quotas for project 93d78bffa2c740b1aa7e09882a90eb9a. Resources: {'cores', 'ram', 'instances'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:34:02.621839 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-5e881e7a-68e6-4471-996f-9c74dd66cd99 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Getting quotas for user ee19faf2a2c54b19a9dc01d28f045b3a and project 93d78bffa2c740b1aa7e09882a90eb9a. Resources: {'cores', 'ram', 'instances'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:34:02.633079 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-5e881e7a-68e6-4471-996f-9c74dd66cd99 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Going to run 1 instances... {{(pid=120750) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:34:02.636104 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-5e881e7a-68e6-4471-996f-9c74dd66cd99 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aaf4ebd-395b-468e-bb6b-c663d01edea0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120750) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:34:02.685070 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-5e881e7a-68e6-4471-996f-9c74dd66cd99 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.584974 Aug 31 12:34:02.685758 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 220/450] 10.222.0.79 () {62 vars in 1188 bytes} [Wed Aug 31 12:34:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 12:34:02.697273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-de8bf6dc-3cec-4067-a751-2ce0d2bc0dfd tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:02.698613 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-de8bf6dc-3cec-4067-a751-2ce0d2bc0dfd tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:02.723542 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-c265081b-c532-4d15-bf92-f27165a8f6a8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:02.724194 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-c265081b-c532-4d15-bf92-f27165a8f6a8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:02.736536 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c265081b-c532-4d15-bf92-f27165a8f6a8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:02.737026 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c265081b-c532-4d15-bf92-f27165a8f6a8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:02.737453 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c265081b-c532-4d15-bf92-f27165a8f6a8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:02.738376 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c265081b-c532-4d15-bf92-f27165a8f6a8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:02.738909 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c265081b-c532-4d15-bf92-f27165a8f6a8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:02.739264 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c265081b-c532-4d15-bf92-f27165a8f6a8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:02.757386 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-de8bf6dc-3cec-4067-a751-2ce0d2bc0dfd tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:02.769871 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-de8bf6dc-3cec-4067-a751-2ce0d2bc0dfd tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:02.772422 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-de8bf6dc-3cec-4067-a751-2ce0d2bc0dfd tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:02.773630 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-de8bf6dc-3cec-4067-a751-2ce0d2bc0dfd tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1280 microversion: 2.20 time: 0.080485 Aug 31 12:34:02.774494 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 231/451] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:34:02 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1280 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:34:02.927322 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-c265081b-c532-4d15-bf92-f27165a8f6a8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:02.938207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-c265081b-c532-4d15-bf92-f27165a8f6a8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1735 microversion: 2.1 time: 0.220811 Aug 31 12:34:02.938913 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 221/452] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:02 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1735 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:34:03.805132 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-3ec2f84c-f262-4196-92cf-c66bc699a7d2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:03.805772 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-3ec2f84c-f262-4196-92cf-c66bc699a7d2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:03.814030 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3ec2f84c-f262-4196-92cf-c66bc699a7d2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:03.814526 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3ec2f84c-f262-4196-92cf-c66bc699a7d2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:03.815005 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3ec2f84c-f262-4196-92cf-c66bc699a7d2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:03.815713 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3ec2f84c-f262-4196-92cf-c66bc699a7d2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:03.816169 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3ec2f84c-f262-4196-92cf-c66bc699a7d2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:03.816593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3ec2f84c-f262-4196-92cf-c66bc699a7d2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:03.888203 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-3ec2f84c-f262-4196-92cf-c66bc699a7d2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:03.903520 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-3ec2f84c-f262-4196-92cf-c66bc699a7d2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:03.907012 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-3ec2f84c-f262-4196-92cf-c66bc699a7d2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:03.908962 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-3ec2f84c-f262-4196-92cf-c66bc699a7d2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1332 microversion: 2.20 time: 0.107738 Aug 31 12:34:03.909770 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 232/453] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:34:03 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:34:03.965496 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-c64d880f-aa62-431f-835e-e05f7c63887c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:03.966818 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-c64d880f-aa62-431f-835e-e05f7c63887c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:03.975529 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c64d880f-aa62-431f-835e-e05f7c63887c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:03.976324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c64d880f-aa62-431f-835e-e05f7c63887c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:03.976991 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c64d880f-aa62-431f-835e-e05f7c63887c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:03.978056 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c64d880f-aa62-431f-835e-e05f7c63887c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:03.978864 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c64d880f-aa62-431f-835e-e05f7c63887c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:03.979849 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c64d880f-aa62-431f-835e-e05f7c63887c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:04.138748 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-c64d880f-aa62-431f-835e-e05f7c63887c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:04.154297 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-c64d880f-aa62-431f-835e-e05f7c63887c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1715 microversion: 2.1 time: 0.195747 Aug 31 12:34:04.155704 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 222/454] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:03 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1715 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:34:04.277553 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-82947fbb-cb29-4360-80cb-9dd052352786 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:04.278177 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-82947fbb-cb29-4360-80cb-9dd052352786 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:04.285343 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-82947fbb-cb29-4360-80cb-9dd052352786 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:04.285924 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-82947fbb-cb29-4360-80cb-9dd052352786 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:04.286451 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-82947fbb-cb29-4360-80cb-9dd052352786 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:04.287284 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-82947fbb-cb29-4360-80cb-9dd052352786 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:04.287806 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-82947fbb-cb29-4360-80cb-9dd052352786 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:04.288334 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-82947fbb-cb29-4360-80cb-9dd052352786 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:04.427407 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.wsgi [None req-82947fbb-cb29-4360-80cb-9dd052352786 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] HTTP exception thrown: Cannot 'detach_volume' instance 247cb5f7-647e-4e39-8a71-99a980f3e7f6 while it is in vm_state rescued Aug 31 12:34:04.428782 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-82947fbb-cb29-4360-80cb-9dd052352786 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Request method failure captured: Aug 31 12:34:04.428782 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: request: DELETE /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6/os-volume_attachments/6c1945ee-2958-41bc-ac34-4e44e5eb4f11 HTTP/1.1 Aug 31 12:34:04.428782 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept: application/json Aug 31 12:34:04.428782 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept-Encoding: identity Aug 31 12:34:04.428782 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Connection: close Aug 31 12:34:04.428782 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Length: 0 Aug 31 12:34:04.428782 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Type: application/json Aug 31 12:34:04.428782 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Host: 10.222.0.79 Aug 31 12:34:04.428782 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Openstack-System-Scope: None Aug 31 12:34:04.428782 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: User-Agent: python-urllib3/1.26.12 Aug 31 12:34:04.428782 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Auth-Token: gAAAAABjD1Q7JmiC9D834ocUdlCNr9HFRkA87wJ_FnUzJGxT5zTT8rU_zms7dDN50ARDsmwlrghc2tCu0r2wB4GfrFjOoimGbd6UfedSwZbznp9qT7fwLaJQHObEsIlJw2EeYd6b0WddqHNk8K0X0vyDMsTdb6In3CN19MqWaCjmEyAxCldxgtw Aug 31 12:34:04.428782 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Id: None Aug 31 12:34:04.428782 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Name: None Aug 31 12:34:04.428782 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Identity-Status: Confirmed Aug 31 12:34:04.428782 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Is-Admin-Project: True Aug 31 12:34:04.428782 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Id: default Aug 31 12:34:04.428782 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Name: Default Aug 31 12:34:04.428782 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Id: 7327d2f6422e4bdb9e250e44987dace3 Aug 31 12:34:04.428782 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-274391016 Aug 31 12:34:04.428782 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Role: reader,member Aug 31 12:34:04.428782 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Roles: reader,member Aug 31 12:34:04.431238 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7327d2f6422e4bdb9e250e44987dace3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7327d2f6422e4bdb9e250e44987dace3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7327d2f6422e4bdb9e250e44987dace3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7327d2f6422e4bdb9e250e44987dace3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:34:04.431238 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant: tempest-ServerRescueNegativeTestJSON-274391016 Aug 31 12:34:04.431238 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Id: 7327d2f6422e4bdb9e250e44987dace3 Aug 31 12:34:04.431238 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-274391016 Aug 31 12:34:04.431238 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User: tempest-ServerRescueNegativeTestJSON-274391016-project Aug 31 12:34:04.431238 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Id: default Aug 31 12:34:04.431238 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Name: Default Aug 31 12:34:04.431238 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Id: 64886d73c79649d1a824170a33f53fcb Aug 31 12:34:04.431238 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Name: tempest-ServerRescueNegativeTestJSON-274391016-project Aug 31 12:34:04.431238 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: method: > Aug 31 12:34:04.431238 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: exception: Cannot 'detach_volume' instance 247cb5f7-647e-4e39-8a71-99a980f3e7f6 while it is in vm_state rescued Aug 31 12:34:04.432378 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: action_args: {'server_id': '247cb5f7-647e-4e39-8a71-99a980f3e7f6', 'id': '6c1945ee-2958-41bc-ac34-4e44e5eb4f11'} Aug 31 12:34:04.432378 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:34:04.432378 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:34:04.432378 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 12:34:04.432378 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 12:34:04.432378 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 12:34:04.432378 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 12:34:04.432378 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 12:34:04.432378 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 12:34:04.432378 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 247cb5f7-647e-4e39-8a71-99a980f3e7f6 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 31 12:34:04.432378 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:34:04.432378 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:34:04.432378 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:34:04.432378 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:34:04.432378 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:34:04.432378 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:34:04.432378 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:34:04.432378 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:34:04.432378 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:34:04.432378 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:34:04.434462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 31 12:34:04.434462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 12:34:04.434462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 12:34:04.434462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 12:34:04.434462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 247cb5f7-647e-4e39-8a71-99a980f3e7f6 while it is in vm_state rescued Aug 31 12:34:04.434462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:34:04.434462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:34:04.434462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:34:04.434462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:34:04.434462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:34:04.434462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:34:04.434462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:34:04.434462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:34:04.434462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 247cb5f7-647e-4e39-8a71-99a980f3e7f6 while it is in vm_state rescued Aug 31 12:34:04.434462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:34:04.434462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-82947fbb-cb29-4360-80cb-9dd052352786 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Returning 409 to user: Cannot 'detach_volume' instance 247cb5f7-647e-4e39-8a71-99a980f3e7f6 while it is in vm_state rescued {{(pid=120749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:34:04.436216 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-82947fbb-cb29-4360-80cb-9dd052352786 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "DELETE /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6/os-volume_attachments/6c1945ee-2958-41bc-ac34-4e44e5eb4f11" status: 409 len: 152 microversion: 2.1 time: 0.157083 Aug 31 12:34:04.436216 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 233/455] 10.222.0.79 () {58 vars in 1416 bytes} [Wed Aug 31 12:34:04 2022] DELETE /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6/os-volume_attachments/6c1945ee-2958-41bc-ac34-4e44e5eb4f11 => generated 152 bytes in 158 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 12:34:04.441097 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-9006ed82-6de3-4807-afbe-4d7117004ee3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:34:04.441638 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-9006ed82-6de3-4807-afbe-4d7117004ee3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:04.447618 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9006ed82-6de3-4807-afbe-4d7117004ee3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:04.448097 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9006ed82-6de3-4807-afbe-4d7117004ee3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:04.448527 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9006ed82-6de3-4807-afbe-4d7117004ee3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:04.449214 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9006ed82-6de3-4807-afbe-4d7117004ee3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:04.449664 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9006ed82-6de3-4807-afbe-4d7117004ee3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:04.450180 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9006ed82-6de3-4807-afbe-4d7117004ee3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:04.500970 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:34:04.523346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-9006ed82-6de3-4807-afbe-4d7117004ee3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "POST /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6/action" status: 202 len: 0 microversion: 2.1 time: 0.086590 Aug 31 12:34:04.527228 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 223/456] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Aug 31 12:34:04 2022] POST /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:34:04.533639 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-cddad99e-8f67-47af-80a5-24b5790108dc tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:04.535013 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-cddad99e-8f67-47af-80a5-24b5790108dc tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:04.541905 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cddad99e-8f67-47af-80a5-24b5790108dc tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:04.542404 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cddad99e-8f67-47af-80a5-24b5790108dc tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:04.542935 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cddad99e-8f67-47af-80a5-24b5790108dc tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:04.543689 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cddad99e-8f67-47af-80a5-24b5790108dc tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:04.544157 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cddad99e-8f67-47af-80a5-24b5790108dc tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:04.544560 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cddad99e-8f67-47af-80a5-24b5790108dc tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:04.772549 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-cddad99e-8f67-47af-80a5-24b5790108dc tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:04.783462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-cddad99e-8f67-47af-80a5-24b5790108dc tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1723 microversion: 2.1 time: 0.254706 Aug 31 12:34:04.784392 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 234/457] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:04 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:34:04.934791 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-2a634857-edc4-4ba9-8454-d8c5351f7730 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:04.935873 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-2a634857-edc4-4ba9-8454-d8c5351f7730 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:04.943636 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2a634857-edc4-4ba9-8454-d8c5351f7730 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:04.944285 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2a634857-edc4-4ba9-8454-d8c5351f7730 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:04.944730 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2a634857-edc4-4ba9-8454-d8c5351f7730 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:04.945457 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2a634857-edc4-4ba9-8454-d8c5351f7730 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:04.945918 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2a634857-edc4-4ba9-8454-d8c5351f7730 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:04.946342 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2a634857-edc4-4ba9-8454-d8c5351f7730 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:05.217677 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-2a634857-edc4-4ba9-8454-d8c5351f7730 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:05.240806 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-2a634857-edc4-4ba9-8454-d8c5351f7730 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:05.243393 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-2a634857-edc4-4ba9-8454-d8c5351f7730 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:05.245293 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-2a634857-edc4-4ba9-8454-d8c5351f7730 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1406 microversion: 2.20 time: 0.315106 Aug 31 12:34:05.246198 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 224/458] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:34:04 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1406 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:34:05.789446 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-2bbaf96a-4114-4d46-93af-774d5edecc67 req-587c6884-9245-41bb-b1f9-09099a8353ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bee1640-e8d5-48a7-b437-414aac42397a", "tag": "b673aa1b-a57f-46f1-bb92-bd62f55d451c"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:34:05.804895 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-d80132d4-6de9-4b2e-a667-6c4448c588f3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:05.805502 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-d80132d4-6de9-4b2e-a667-6c4448c588f3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:05.806378 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-2bbaf96a-4114-4d46-93af-774d5edecc67 req-587c6884-9245-41bb-b1f9-09099a8353ca service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:05.806956 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-2bbaf96a-4114-4d46-93af-774d5edecc67 req-587c6884-9245-41bb-b1f9-09099a8353ca service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:05.807445 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-2bbaf96a-4114-4d46-93af-774d5edecc67 req-587c6884-9245-41bb-b1f9-09099a8353ca service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:05.813923 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d80132d4-6de9-4b2e-a667-6c4448c588f3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:05.814687 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d80132d4-6de9-4b2e-a667-6c4448c588f3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:05.815322 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d80132d4-6de9-4b2e-a667-6c4448c588f3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:05.816219 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d80132d4-6de9-4b2e-a667-6c4448c588f3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:05.816671 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d80132d4-6de9-4b2e-a667-6c4448c588f3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:05.817272 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d80132d4-6de9-4b2e-a667-6c4448c588f3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:05.823272 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-2bbaf96a-4114-4d46-93af-774d5edecc67 req-587c6884-9245-41bb-b1f9-09099a8353ca service nova] Creating event network-changed:b673aa1b-a57f-46f1-bb92-bd62f55d451c for instance 8bee1640-e8d5-48a7-b437-414aac42397a on hv-cinder-85528 Aug 31 12:34:05.830331 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-2bbaf96a-4114-4d46-93af-774d5edecc67 req-587c6884-9245-41bb-b1f9-09099a8353ca service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044234 Aug 31 12:34:05.831325 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 235/459] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:34:05.953263 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-d80132d4-6de9-4b2e-a667-6c4448c588f3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:05.962925 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-d80132d4-6de9-4b2e-a667-6c4448c588f3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1723 microversion: 2.1 time: 0.161891 Aug 31 12:34:05.963505 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 225/460] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:05 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:34:06.275477 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-32dc2875-f0ac-49c1-a5aa-3b71731b9313 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:06.276164 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-32dc2875-f0ac-49c1-a5aa-3b71731b9313 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:06.282906 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-32dc2875-f0ac-49c1-a5aa-3b71731b9313 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:06.283395 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-32dc2875-f0ac-49c1-a5aa-3b71731b9313 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:06.283823 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-32dc2875-f0ac-49c1-a5aa-3b71731b9313 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:06.284514 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-32dc2875-f0ac-49c1-a5aa-3b71731b9313 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:06.284959 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-32dc2875-f0ac-49c1-a5aa-3b71731b9313 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:06.285376 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-32dc2875-f0ac-49c1-a5aa-3b71731b9313 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:06.421300 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-32dc2875-f0ac-49c1-a5aa-3b71731b9313 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:06.429655 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-32dc2875-f0ac-49c1-a5aa-3b71731b9313 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:06.431029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-32dc2875-f0ac-49c1-a5aa-3b71731b9313 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:06.432143 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-32dc2875-f0ac-49c1-a5aa-3b71731b9313 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1406 microversion: 2.20 time: 0.160933 Aug 31 12:34:06.432700 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 236/461] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:34:06 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:34:06.985617 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-883a439f-b825-43c0-9967-5739907b5ef8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:06.986280 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-883a439f-b825-43c0-9967-5739907b5ef8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:06.992682 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-883a439f-b825-43c0-9967-5739907b5ef8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:06.993156 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-883a439f-b825-43c0-9967-5739907b5ef8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:06.993580 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-883a439f-b825-43c0-9967-5739907b5ef8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:06.994287 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-883a439f-b825-43c0-9967-5739907b5ef8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:06.994728 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-883a439f-b825-43c0-9967-5739907b5ef8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:06.995163 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-883a439f-b825-43c0-9967-5739907b5ef8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:07.128107 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-883a439f-b825-43c0-9967-5739907b5ef8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:07.137669 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-883a439f-b825-43c0-9967-5739907b5ef8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1729 microversion: 2.1 time: 0.156806 Aug 31 12:34:07.138404 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 226/462] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:06 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:34:07.162644 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-0e05f3e9-49ad-4b60-aeb0-523b04716a0c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:07.163268 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-0e05f3e9-49ad-4b60-aeb0-523b04716a0c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:07.169489 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0e05f3e9-49ad-4b60-aeb0-523b04716a0c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:07.169965 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0e05f3e9-49ad-4b60-aeb0-523b04716a0c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:07.170409 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0e05f3e9-49ad-4b60-aeb0-523b04716a0c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:07.171331 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0e05f3e9-49ad-4b60-aeb0-523b04716a0c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:07.171781 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0e05f3e9-49ad-4b60-aeb0-523b04716a0c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:07.172206 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0e05f3e9-49ad-4b60-aeb0-523b04716a0c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:07.291347 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-0e05f3e9-49ad-4b60-aeb0-523b04716a0c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.132411 Aug 31 12:34:07.291946 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 237/463] 10.222.0.79 () {58 vars in 1275 bytes} [Wed Aug 31 12:34:07 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6/os-interface => generated 285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:34:07.456662 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-d42e09f0-30f8-4753-abfa-a1db088268b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:07.457287 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-d42e09f0-30f8-4753-abfa-a1db088268b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:07.463201 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d42e09f0-30f8-4753-abfa-a1db088268b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:07.463883 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d42e09f0-30f8-4753-abfa-a1db088268b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:07.464502 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d42e09f0-30f8-4753-abfa-a1db088268b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:07.465183 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d42e09f0-30f8-4753-abfa-a1db088268b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:07.465724 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d42e09f0-30f8-4753-abfa-a1db088268b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:07.466329 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d42e09f0-30f8-4753-abfa-a1db088268b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:07.701910 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-d42e09f0-30f8-4753-abfa-a1db088268b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:07.713611 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-d42e09f0-30f8-4753-abfa-a1db088268b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:07.715444 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-d42e09f0-30f8-4753-abfa-a1db088268b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:07.716696 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-d42e09f0-30f8-4753-abfa-a1db088268b8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1406 microversion: 2.20 time: 0.264491 Aug 31 12:34:07.719180 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 227/464] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:34:07 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:34:08.667123 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-4d97f414-0fbc-4e10-8b08-3437ce1d09b8 req-f7daa273-2ba4-417e-b753-24911da47699 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "247cb5f7-647e-4e39-8a71-99a980f3e7f6", "tag": "3294c27b-cd99-416f-b4b3-6c18cb978a29"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:34:08.680671 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-4d97f414-0fbc-4e10-8b08-3437ce1d09b8 req-f7daa273-2ba4-417e-b753-24911da47699 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:08.681449 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-4d97f414-0fbc-4e10-8b08-3437ce1d09b8 req-f7daa273-2ba4-417e-b753-24911da47699 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:08.682384 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-4d97f414-0fbc-4e10-8b08-3437ce1d09b8 req-f7daa273-2ba4-417e-b753-24911da47699 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:08.701074 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-4d97f414-0fbc-4e10-8b08-3437ce1d09b8 req-f7daa273-2ba4-417e-b753-24911da47699 service nova] Creating event network-changed:3294c27b-cd99-416f-b4b3-6c18cb978a29 for instance 247cb5f7-647e-4e39-8a71-99a980f3e7f6 on hv-cinder-85528 Aug 31 12:34:08.708060 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-4d97f414-0fbc-4e10-8b08-3437ce1d09b8 req-f7daa273-2ba4-417e-b753-24911da47699 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044910 Aug 31 12:34:08.708751 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 238/465] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:34:08.745903 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-1de9bf7c-900c-4b29-bfbd-c35e8c4fbb0e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:08.747038 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-1de9bf7c-900c-4b29-bfbd-c35e8c4fbb0e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:08.755450 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1de9bf7c-900c-4b29-bfbd-c35e8c4fbb0e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:08.755945 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1de9bf7c-900c-4b29-bfbd-c35e8c4fbb0e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:08.756380 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1de9bf7c-900c-4b29-bfbd-c35e8c4fbb0e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:08.757094 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1de9bf7c-900c-4b29-bfbd-c35e8c4fbb0e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:08.757549 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1de9bf7c-900c-4b29-bfbd-c35e8c4fbb0e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:08.757968 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1de9bf7c-900c-4b29-bfbd-c35e8c4fbb0e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:08.947851 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-1de9bf7c-900c-4b29-bfbd-c35e8c4fbb0e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:08.962043 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-1de9bf7c-900c-4b29-bfbd-c35e8c4fbb0e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:08.964217 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-1de9bf7c-900c-4b29-bfbd-c35e8c4fbb0e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:08.965828 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-1de9bf7c-900c-4b29-bfbd-c35e8c4fbb0e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1406 microversion: 2.20 time: 0.225774 Aug 31 12:34:08.966767 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 228/466] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:34:08 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:34:09.991005 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-d95a1b79-b321-4f28-aa55-a5720664233d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:09.991603 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-d95a1b79-b321-4f28-aa55-a5720664233d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:09.997977 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d95a1b79-b321-4f28-aa55-a5720664233d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:09.998457 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d95a1b79-b321-4f28-aa55-a5720664233d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:09.999516 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d95a1b79-b321-4f28-aa55-a5720664233d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:10.000443 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d95a1b79-b321-4f28-aa55-a5720664233d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:10.000888 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d95a1b79-b321-4f28-aa55-a5720664233d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:10.001308 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d95a1b79-b321-4f28-aa55-a5720664233d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:10.133360 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-d95a1b79-b321-4f28-aa55-a5720664233d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:10.137171 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=100 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:34:10.143993 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-d95a1b79-b321-4f28-aa55-a5720664233d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:10.145417 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-d95a1b79-b321-4f28-aa55-a5720664233d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:10.146529 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-d95a1b79-b321-4f28-aa55-a5720664233d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1406 microversion: 2.20 time: 0.160626 Aug 31 12:34:10.147110 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 239/467] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:34:09 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:34:10.724129 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-6d5f57bd-d285-4fc0-a27f-8a50af5564db req-bcfc36c9-9f9a-4eca-a977-b58b4f5b96b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "247cb5f7-647e-4e39-8a71-99a980f3e7f6", "tag": "3294c27b-cd99-416f-b4b3-6c18cb978a29"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:34:10.735793 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-6d5f57bd-d285-4fc0-a27f-8a50af5564db req-bcfc36c9-9f9a-4eca-a977-b58b4f5b96b3 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:10.736265 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-6d5f57bd-d285-4fc0-a27f-8a50af5564db req-bcfc36c9-9f9a-4eca-a977-b58b4f5b96b3 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:10.736686 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-6d5f57bd-d285-4fc0-a27f-8a50af5564db req-bcfc36c9-9f9a-4eca-a977-b58b4f5b96b3 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:10.748391 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-6d5f57bd-d285-4fc0-a27f-8a50af5564db req-bcfc36c9-9f9a-4eca-a977-b58b4f5b96b3 service nova] Creating event network-changed:3294c27b-cd99-416f-b4b3-6c18cb978a29 for instance 247cb5f7-647e-4e39-8a71-99a980f3e7f6 on hv-cinder-85528 Aug 31 12:34:10.753805 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-6d5f57bd-d285-4fc0-a27f-8a50af5564db req-bcfc36c9-9f9a-4eca-a977-b58b4f5b96b3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033811 Aug 31 12:34:10.754403 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 229/468] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:34:11.170972 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-f9afe2ec-89a0-434e-9671-bcc6b1d33468 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:11.172404 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-f9afe2ec-89a0-434e-9671-bcc6b1d33468 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:11.179220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f9afe2ec-89a0-434e-9671-bcc6b1d33468 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:11.179751 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f9afe2ec-89a0-434e-9671-bcc6b1d33468 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:11.180141 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f9afe2ec-89a0-434e-9671-bcc6b1d33468 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:11.181353 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f9afe2ec-89a0-434e-9671-bcc6b1d33468 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:11.181766 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f9afe2ec-89a0-434e-9671-bcc6b1d33468 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:11.182514 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f9afe2ec-89a0-434e-9671-bcc6b1d33468 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:11.391839 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-f9afe2ec-89a0-434e-9671-bcc6b1d33468 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:11.403766 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-f9afe2ec-89a0-434e-9671-bcc6b1d33468 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:11.406537 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-f9afe2ec-89a0-434e-9671-bcc6b1d33468 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:11.408150 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-f9afe2ec-89a0-434e-9671-bcc6b1d33468 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1406 microversion: 2.20 time: 0.241444 Aug 31 12:34:11.408901 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 240/469] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:34:11 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:34:12.433924 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-c821a625-cc55-4535-8f10-b29406742602 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:12.434517 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-c821a625-cc55-4535-8f10-b29406742602 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:12.441323 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c821a625-cc55-4535-8f10-b29406742602 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:12.441818 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c821a625-cc55-4535-8f10-b29406742602 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:12.442238 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c821a625-cc55-4535-8f10-b29406742602 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:12.442960 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c821a625-cc55-4535-8f10-b29406742602 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:12.443406 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c821a625-cc55-4535-8f10-b29406742602 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:12.443824 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c821a625-cc55-4535-8f10-b29406742602 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:12.582715 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-c821a625-cc55-4535-8f10-b29406742602 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:12.591601 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-c821a625-cc55-4535-8f10-b29406742602 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:12.593661 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-c821a625-cc55-4535-8f10-b29406742602 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:12.594984 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-c821a625-cc55-4535-8f10-b29406742602 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1406 microversion: 2.20 time: 0.166008 Aug 31 12:34:12.595562 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 230/470] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:34:12 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:34:13.088527 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-1e44a4b1-0d63-4c65-a607-33712935540f req-ce3bce65-fa1e-4ef3-96ed-ca40a8a6a9ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bee1640-e8d5-48a7-b437-414aac42397a", "name": "network-vif-plugged", "status": "completed", "tag": "b673aa1b-a57f-46f1-bb92-bd62f55d451c"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:34:13.096605 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=2 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:34:13.107285 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-1e44a4b1-0d63-4c65-a607-33712935540f req-ce3bce65-fa1e-4ef3-96ed-ca40a8a6a9ea service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:13.107773 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-1e44a4b1-0d63-4c65-a607-33712935540f req-ce3bce65-fa1e-4ef3-96ed-ca40a8a6a9ea service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:13.108299 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-1e44a4b1-0d63-4c65-a607-33712935540f req-ce3bce65-fa1e-4ef3-96ed-ca40a8a6a9ea service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:13.120845 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-1e44a4b1-0d63-4c65-a607-33712935540f req-ce3bce65-fa1e-4ef3-96ed-ca40a8a6a9ea service nova] Creating event network-vif-plugged:b673aa1b-a57f-46f1-bb92-bd62f55d451c for instance 8bee1640-e8d5-48a7-b437-414aac42397a on hv-cinder-85528 Aug 31 12:34:13.126293 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-1e44a4b1-0d63-4c65-a607-33712935540f req-ce3bce65-fa1e-4ef3-96ed-ca40a8a6a9ea service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041841 Aug 31 12:34:13.126922 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 241/471] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:34:13.617411 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-f949b251-a014-4342-9a4e-c53c0a571dc9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:13.618026 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-f949b251-a014-4342-9a4e-c53c0a571dc9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:13.619939 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell0:SELECT=2 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:34:13.620622 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell0:SELECT=10 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:34:13.627643 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f949b251-a014-4342-9a4e-c53c0a571dc9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:13.628128 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f949b251-a014-4342-9a4e-c53c0a571dc9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:13.628565 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f949b251-a014-4342-9a4e-c53c0a571dc9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:13.629257 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f949b251-a014-4342-9a4e-c53c0a571dc9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:13.629707 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f949b251-a014-4342-9a4e-c53c0a571dc9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:13.630127 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f949b251-a014-4342-9a4e-c53c0a571dc9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:13.761630 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f949b251-a014-4342-9a4e-c53c0a571dc9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:13.771178 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f949b251-a014-4342-9a4e-c53c0a571dc9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:13.773969 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f949b251-a014-4342-9a4e-c53c0a571dc9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:13.775190 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-f949b251-a014-4342-9a4e-c53c0a571dc9 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1406 microversion: 2.20 time: 0.161706 Aug 31 12:34:13.775758 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 231/472] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:34:13 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:34:14.801002 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-b06e7ce1-1cd6-4d14-9164-47ccfd95d89d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:14.801690 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-b06e7ce1-1cd6-4d14-9164-47ccfd95d89d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:14.807760 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b06e7ce1-1cd6-4d14-9164-47ccfd95d89d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:14.808238 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b06e7ce1-1cd6-4d14-9164-47ccfd95d89d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:14.808664 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b06e7ce1-1cd6-4d14-9164-47ccfd95d89d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:14.809338 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b06e7ce1-1cd6-4d14-9164-47ccfd95d89d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:14.809797 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b06e7ce1-1cd6-4d14-9164-47ccfd95d89d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:14.810190 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b06e7ce1-1cd6-4d14-9164-47ccfd95d89d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:14.955600 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-b06e7ce1-1cd6-4d14-9164-47ccfd95d89d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:14.963996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-b06e7ce1-1cd6-4d14-9164-47ccfd95d89d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:14.965445 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-b06e7ce1-1cd6-4d14-9164-47ccfd95d89d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:14.966577 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-b06e7ce1-1cd6-4d14-9164-47ccfd95d89d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1406 microversion: 2.20 time: 0.171170 Aug 31 12:34:14.967155 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 242/473] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:34:14 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:34:15.989779 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b8c1ee7a-7e13-41cf-b872-52f5491d7eaf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:15.990378 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-b8c1ee7a-7e13-41cf-b872-52f5491d7eaf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:15.996949 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8c1ee7a-7e13-41cf-b872-52f5491d7eaf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:15.997427 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8c1ee7a-7e13-41cf-b872-52f5491d7eaf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:15.997856 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8c1ee7a-7e13-41cf-b872-52f5491d7eaf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:15.998538 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8c1ee7a-7e13-41cf-b872-52f5491d7eaf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:15.999065 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8c1ee7a-7e13-41cf-b872-52f5491d7eaf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:15.999995 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8c1ee7a-7e13-41cf-b872-52f5491d7eaf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:16.130079 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b8c1ee7a-7e13-41cf-b872-52f5491d7eaf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:16.138176 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b8c1ee7a-7e13-41cf-b872-52f5491d7eaf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:16.139690 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b8c1ee7a-7e13-41cf-b872-52f5491d7eaf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:16.141157 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b8c1ee7a-7e13-41cf-b872-52f5491d7eaf tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1599 microversion: 2.20 time: 0.155271 Aug 31 12:34:16.141716 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 232/474] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:34:15 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:34:16.163628 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-22683496-44b8-469c-910f-4d8f3d96141a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:16.164164 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-22683496-44b8-469c-910f-4d8f3d96141a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:16.170504 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-22683496-44b8-469c-910f-4d8f3d96141a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:16.171622 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-22683496-44b8-469c-910f-4d8f3d96141a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:16.172059 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-22683496-44b8-469c-910f-4d8f3d96141a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:16.172749 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-22683496-44b8-469c-910f-4d8f3d96141a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:16.173206 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-22683496-44b8-469c-910f-4d8f3d96141a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:16.173633 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-22683496-44b8-469c-910f-4d8f3d96141a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:16.257798 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-22683496-44b8-469c-910f-4d8f3d96141a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.097922 Aug 31 12:34:16.258395 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 243/475] 10.222.0.79 () {60 vars in 1316 bytes} [Wed Aug 31 12:34:16 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:34:17.442073 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-230e18e4-a271-4377-b20a-1ab26eb6d0a6 req-282585dc-77ae-4037-a050-b894ab7f44f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bee1640-e8d5-48a7-b437-414aac42397a", "tag": "b673aa1b-a57f-46f1-bb92-bd62f55d451c"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:34:17.452884 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-230e18e4-a271-4377-b20a-1ab26eb6d0a6 req-282585dc-77ae-4037-a050-b894ab7f44f8 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:17.453364 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-230e18e4-a271-4377-b20a-1ab26eb6d0a6 req-282585dc-77ae-4037-a050-b894ab7f44f8 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:17.453786 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-230e18e4-a271-4377-b20a-1ab26eb6d0a6 req-282585dc-77ae-4037-a050-b894ab7f44f8 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:17.465526 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-230e18e4-a271-4377-b20a-1ab26eb6d0a6 req-282585dc-77ae-4037-a050-b894ab7f44f8 service nova] Creating event network-changed:b673aa1b-a57f-46f1-bb92-bd62f55d451c for instance 8bee1640-e8d5-48a7-b437-414aac42397a on hv-cinder-85528 Aug 31 12:34:17.471877 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-230e18e4-a271-4377-b20a-1ab26eb6d0a6 req-282585dc-77ae-4037-a050-b894ab7f44f8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032796 Aug 31 12:34:17.472480 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 233/476] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:34:22.049849 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-38963bf0-9c42-46bf-b6ed-25d742227401 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:22.052041 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-38963bf0-9c42-46bf-b6ed-25d742227401 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:22.058145 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-38963bf0-9c42-46bf-b6ed-25d742227401 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:22.058639 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-38963bf0-9c42-46bf-b6ed-25d742227401 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:22.059104 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-38963bf0-9c42-46bf-b6ed-25d742227401 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:22.059806 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-38963bf0-9c42-46bf-b6ed-25d742227401 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:22.060262 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-38963bf0-9c42-46bf-b6ed-25d742227401 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:22.060689 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-38963bf0-9c42-46bf-b6ed-25d742227401 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:22.093367 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-38963bf0-9c42-46bf-b6ed-25d742227401 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048725 Aug 31 12:34:22.094531 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 244/477] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 31 12:34:22 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 12:34:22.159090 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-495e83e6-b8a6-41e8-b294-dde0a61a166a tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:22.159650 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-495e83e6-b8a6-41e8-b294-dde0a61a166a tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:22.166352 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-495e83e6-b8a6-41e8-b294-dde0a61a166a tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:22.166834 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-495e83e6-b8a6-41e8-b294-dde0a61a166a tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:22.167284 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-495e83e6-b8a6-41e8-b294-dde0a61a166a tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:22.167978 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-495e83e6-b8a6-41e8-b294-dde0a61a166a tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:22.168425 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-495e83e6-b8a6-41e8-b294-dde0a61a166a tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:22.168838 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-495e83e6-b8a6-41e8-b294-dde0a61a166a tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:22.196273 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-495e83e6-b8a6-41e8-b294-dde0a61a166a tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Going to try to terminate instance {{(pid=120750) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:34:22.282712 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-495e83e6-b8a6-41e8-b294-dde0a61a166a tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "DELETE /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 204 len: 0 microversion: 2.1 time: 0.127856 Aug 31 12:34:22.283353 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 234/478] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 31 12:34:22 2022] DELETE /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:34:22.293386 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-39f0f2d5-08f2-499a-bebd-b4be57c945ed tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:22.294021 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-39f0f2d5-08f2-499a-bebd-b4be57c945ed tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:22.302807 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-39f0f2d5-08f2-499a-bebd-b4be57c945ed tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:22.304071 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-39f0f2d5-08f2-499a-bebd-b4be57c945ed tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:22.304071 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-39f0f2d5-08f2-499a-bebd-b4be57c945ed tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:22.304474 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-39f0f2d5-08f2-499a-bebd-b4be57c945ed tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:22.304939 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-39f0f2d5-08f2-499a-bebd-b4be57c945ed tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:22.305366 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-39f0f2d5-08f2-499a-bebd-b4be57c945ed tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:22.447071 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-39f0f2d5-08f2-499a-bebd-b4be57c945ed tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:22.454798 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-39f0f2d5-08f2-499a-bebd-b4be57c945ed tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1672 microversion: 2.1 time: 0.165930 Aug 31 12:34:22.455402 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 245/479] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:22 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:34:23.476913 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-36c11e85-625d-4d79-9d1c-087304f2ed51 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:23.477601 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-36c11e85-625d-4d79-9d1c-087304f2ed51 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:23.484136 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-36c11e85-625d-4d79-9d1c-087304f2ed51 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:23.484950 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-36c11e85-625d-4d79-9d1c-087304f2ed51 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:23.485824 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-36c11e85-625d-4d79-9d1c-087304f2ed51 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:23.486521 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-36c11e85-625d-4d79-9d1c-087304f2ed51 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:23.487006 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-36c11e85-625d-4d79-9d1c-087304f2ed51 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:23.487429 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-36c11e85-625d-4d79-9d1c-087304f2ed51 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:23.615579 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-36c11e85-625d-4d79-9d1c-087304f2ed51 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:23.623174 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-36c11e85-625d-4d79-9d1c-087304f2ed51 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1672 microversion: 2.1 time: 0.150535 Aug 31 12:34:23.623728 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 235/480] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:23 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:34:24.645899 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-50b9ab89-3914-4b33-8407-27cfe5044009 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:24.646506 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-50b9ab89-3914-4b33-8407-27cfe5044009 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:24.653277 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-50b9ab89-3914-4b33-8407-27cfe5044009 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:24.653591 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-50b9ab89-3914-4b33-8407-27cfe5044009 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:24.654021 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-50b9ab89-3914-4b33-8407-27cfe5044009 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:24.654723 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-50b9ab89-3914-4b33-8407-27cfe5044009 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:24.655201 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-50b9ab89-3914-4b33-8407-27cfe5044009 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:24.655620 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-50b9ab89-3914-4b33-8407-27cfe5044009 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:24.910357 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-50b9ab89-3914-4b33-8407-27cfe5044009 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:24.923278 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-50b9ab89-3914-4b33-8407-27cfe5044009 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1672 microversion: 2.1 time: 0.281249 Aug 31 12:34:24.927049 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 246/481] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:24 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1672 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:34:25.354947 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-9d9ca73a-aea9-4672-8870-2868971b00a1 req-fdd7338a-f0ea-4b51-9b5f-860eeb954145 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59de5135-bc13-4ecc-a3b9-015b32aec285", "name": "network-vif-deleted", "tag": "989a01eb-9f16-4e0f-b023-10a0ee6b8e11"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:34:25.379543 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-9d9ca73a-aea9-4672-8870-2868971b00a1 req-fdd7338a-f0ea-4b51-9b5f-860eeb954145 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:25.380019 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-9d9ca73a-aea9-4672-8870-2868971b00a1 req-fdd7338a-f0ea-4b51-9b5f-860eeb954145 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:25.380439 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-9d9ca73a-aea9-4672-8870-2868971b00a1 req-fdd7338a-f0ea-4b51-9b5f-860eeb954145 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:25.392620 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-9d9ca73a-aea9-4672-8870-2868971b00a1 req-fdd7338a-f0ea-4b51-9b5f-860eeb954145 service nova] Creating event network-vif-deleted:989a01eb-9f16-4e0f-b023-10a0ee6b8e11 for instance 59de5135-bc13-4ecc-a3b9-015b32aec285 on hv-cinder-85528 Aug 31 12:34:25.397361 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-9d9ca73a-aea9-4672-8870-2868971b00a1 req-fdd7338a-f0ea-4b51-9b5f-860eeb954145 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051183 Aug 31 12:34:25.398325 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 236/482] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:34:25.945179 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-2b15a9fe-a199-4176-a165-dea26514727c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:25.945719 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-2b15a9fe-a199-4176-a165-dea26514727c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:25.952589 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2b15a9fe-a199-4176-a165-dea26514727c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:25.953966 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2b15a9fe-a199-4176-a165-dea26514727c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:25.954092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2b15a9fe-a199-4176-a165-dea26514727c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:25.954752 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2b15a9fe-a199-4176-a165-dea26514727c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:25.955236 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2b15a9fe-a199-4176-a165-dea26514727c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:25.955657 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2b15a9fe-a199-4176-a165-dea26514727c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:25.994993 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2b15a9fe-a199-4176-a165-dea26514727c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:25.995929 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2b15a9fe-a199-4176-a165-dea26514727c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:25.996366 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2b15a9fe-a199-4176-a165-dea26514727c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:25.996975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.objects.instance [None req-2b15a9fe-a199-4176-a165-dea26514727c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lazy-loading 'fault' on Instance uuid 59de5135-bc13-4ecc-a3b9-015b32aec285 {{(pid=120749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:34:26.046005 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-2b15a9fe-a199-4176-a165-dea26514727c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:26.055058 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-2b15a9fe-a199-4176-a165-dea26514727c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 200 len: 1327 microversion: 2.1 time: 0.114181 Aug 31 12:34:26.056018 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 247/483] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:25 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 1327 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:34:27.079135 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-51b8e061-a492-4661-955e-dc5ab62bf70c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:27.079844 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-51b8e061-a492-4661-955e-dc5ab62bf70c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:27.081854 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:34:27.087564 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-51b8e061-a492-4661-955e-dc5ab62bf70c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:27.088053 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-51b8e061-a492-4661-955e-dc5ab62bf70c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:27.088484 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-51b8e061-a492-4661-955e-dc5ab62bf70c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:27.089189 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-51b8e061-a492-4661-955e-dc5ab62bf70c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:27.089644 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-51b8e061-a492-4661-955e-dc5ab62bf70c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:27.090065 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-51b8e061-a492-4661-955e-dc5ab62bf70c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:27.107913 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-51b8e061-a492-4661-955e-dc5ab62bf70c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] HTTP exception thrown: Instance 59de5135-bc13-4ecc-a3b9-015b32aec285 could not be found. Aug 31 12:34:27.108778 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-51b8e061-a492-4661-955e-dc5ab62bf70c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Request method failure captured: Aug 31 12:34:27.108778 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 HTTP/1.1 Aug 31 12:34:27.108778 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:34:27.108778 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:34:27.108778 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:34:27.108778 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 0 Aug 31 12:34:27.108778 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:34:27.108778 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:34:27.108778 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:34:27.108778 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:34:27.108778 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1Q7v2mO-kd2scOxrG2E8M4nJrqoBKWSkTSI_tfXxHhy7YcIFS2CjLmlIbaT1cJhcU7z1zHp5GfIvWGnI09hIRjHbV9JsC3gZspw702ajUi9P1zq1xok55mpWIQYvGj6EfBDzfBlBMvuenNv6umQC-syhiXVaer2KK3wMNcGEicqoR8 Aug 31 12:34:27.108778 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:34:27.108778 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:34:27.108778 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:34:27.108778 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:34:27.108778 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:34:27.108778 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:34:27.108778 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: 0b1d7ad43ff24c31af3b53349b2063cd Aug 31 12:34:27.108778 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-AttachVolumeTestJSON-634442655 Aug 31 12:34:27.108778 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:34:27.108778 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:34:27.110198 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0b1d7ad43ff24c31af3b53349b2063cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0b1d7ad43ff24c31af3b53349b2063cd", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b1d7ad43ff24c31af3b53349b2063cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b1d7ad43ff24c31af3b53349b2063cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:34:27.110198 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-AttachVolumeTestJSON-634442655 Aug 31 12:34:27.110198 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: 0b1d7ad43ff24c31af3b53349b2063cd Aug 31 12:34:27.110198 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-AttachVolumeTestJSON-634442655 Aug 31 12:34:27.110198 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-AttachVolumeTestJSON-634442655-project Aug 31 12:34:27.110198 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:34:27.110198 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:34:27.110198 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: 937aa5c23271467f83b05f570fde7468 Aug 31 12:34:27.110198 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-AttachVolumeTestJSON-634442655-project Aug 31 12:34:27.110198 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:34:27.110198 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Instance 59de5135-bc13-4ecc-a3b9-015b32aec285 could not be found. Aug 31 12:34:27.110198 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'id': '59de5135-bc13-4ecc-a3b9-015b32aec285'} Aug 31 12:34:27.111312 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:34:27.111312 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:34:27.111312 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:34:27.111312 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:34:27.111312 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:34:27.111312 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:34:27.111312 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:34:27.111312 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:34:27.111312 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:34:27.111312 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:34:27.111312 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59de5135-bc13-4ecc-a3b9-015b32aec285 could not be found. Aug 31 12:34:27.111312 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:34:27.111312 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:34:27.111312 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:34:27.111312 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:34:27.111312 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:34:27.111312 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:34:27.111312 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:34:27.111312 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:34:27.111312 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:34:27.112583 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:34:27.112583 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:34:27.112583 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:34:27.112583 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:34:27.112583 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:34:27.112583 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:34:27.112583 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:34:27.112583 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59de5135-bc13-4ecc-a3b9-015b32aec285 could not be found. Aug 31 12:34:27.112583 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:34:27.112583 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:34:27.112583 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:34:27.112583 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:34:27.112583 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:34:27.112583 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:34:27.112583 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:34:27.112583 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:34:27.112583 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59de5135-bc13-4ecc-a3b9-015b32aec285 could not be found. Aug 31 12:34:27.112583 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:34:27.114011 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-51b8e061-a492-4661-955e-dc5ab62bf70c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Returning 404 to user: Instance 59de5135-bc13-4ecc-a3b9-015b32aec285 could not be found. {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:34:27.114011 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-51b8e061-a492-4661-955e-dc5ab62bf70c tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 404 len: 111 microversion: 2.1 time: 0.036773 Aug 31 12:34:27.114011 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 237/484] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:27 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:34:27.119872 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-0c814edd-67e8-48df-bb78-ebe2405f25e3 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '.version_select at 0x7f8d1719bc10>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:27.143606 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-0c814edd-67e8-48df-bb78-ebe2405f25e3 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2113646768" status: 202 len: 0 microversion: 2.1 time: 0.027516 Aug 31 12:34:27.144169 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 248/485] 10.222.0.79 () {58 vars in 1221 bytes} [Wed Aug 31 12:34:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2113646768 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:34:27.790142 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-68d45fad-16fa-4087-ae0b-ed2cfa887555 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Action: 'create', calling method: .version_select at 0x7f8d170a5550>, body: {"keypair": {"name": "tempest-keypair-1453084084", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3CT+J0pPgJlV5CyAID96uB57aX/7wU9BGXRxOTV35NsERESMR5NwnKIsFsvZOPBVmoXySXCj3dF+aHqx/kYZepEr7UknGm6RFHUlx4D5Ss0qFqmkqghU4DNNO3ASQQNw=="}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:34:27.805667 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-68d45fad-16fa-4087-ae0b-ed2cfa887555 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Getting quotas for project 0b1d7ad43ff24c31af3b53349b2063cd. Resources: {'key_pairs'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:34:27.809483 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-68d45fad-16fa-4087-ae0b-ed2cfa887555 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Getting quotas for user 937aa5c23271467f83b05f570fde7468 and project 0b1d7ad43ff24c31af3b53349b2063cd. Resources: {'key_pairs'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:34:27.832167 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-68d45fad-16fa-4087-ae0b-ed2cfa887555 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046314 Aug 31 12:34:27.832756 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 238/486] 10.222.0.79 () {60 vars in 1159 bytes} [Wed Aug 31 12:34:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:34:29.183005 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-c1a29284-4922-44f3-9e76-bdced28126d7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-406345561", "imageRef": "2aaf4ebd-395b-468e-bb6b-c663d01edea0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a2647de8-4bdf-4f94-856d-7adc190c4c35"}], "security_groups": [{"name": "tempest-securitygroup--464745687"}], "key_name": "tempest-keypair-1453084084", "user_data": "}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:34:29.191944 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:34:29.290388 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.network.neutron [None req-c1a29284-4922-44f3-9e76-bdced28126d7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] validate_networks() for [('a2647de8-4bdf-4f94-856d-7adc190c4c35', None, None, None, None, None)] {{(pid=120749) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:34:29.675794 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-c1a29284-4922-44f3-9e76-bdced28126d7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Flavor limits 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:34:29.676208 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-c1a29284-4922-44f3-9e76-bdced28126d7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Image limits 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:34:29.676732 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-c1a29284-4922-44f3-9e76-bdced28126d7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Flavor pref 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:34:29.677241 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-c1a29284-4922-44f3-9e76-bdced28126d7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Image pref 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:34:29.677626 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-c1a29284-4922-44f3-9e76-bdced28126d7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:34:29.686678 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c1a29284-4922-44f3-9e76-bdced28126d7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:29.687199 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c1a29284-4922-44f3-9e76-bdced28126d7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:29.687623 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c1a29284-4922-44f3-9e76-bdced28126d7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:29.688337 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c1a29284-4922-44f3-9e76-bdced28126d7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:29.688921 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c1a29284-4922-44f3-9e76-bdced28126d7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:29.689250 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c1a29284-4922-44f3-9e76-bdced28126d7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:29.707968 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-c1a29284-4922-44f3-9e76-bdced28126d7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Getting quotas for project 0b1d7ad43ff24c31af3b53349b2063cd. Resources: {'cores', 'ram', 'instances'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:34:29.711872 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-c1a29284-4922-44f3-9e76-bdced28126d7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Getting quotas for user 937aa5c23271467f83b05f570fde7468 and project 0b1d7ad43ff24c31af3b53349b2063cd. Resources: {'cores', 'ram', 'instances'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:34:29.723671 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-c1a29284-4922-44f3-9e76-bdced28126d7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Going to run 1 instances... {{(pid=120749) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:34:29.725948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-c1a29284-4922-44f3-9e76-bdced28126d7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aaf4ebd-395b-468e-bb6b-c663d01edea0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:34:29.773468 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-c1a29284-4922-44f3-9e76-bdced28126d7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.595367 Aug 31 12:34:29.774113 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 249/487] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 31 12:34:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:34:29.786606 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-36747503-8779-4253-9957-493b799bae06 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:29.787277 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-36747503-8779-4253-9957-493b799bae06 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:29.852427 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-36747503-8779-4253-9957-493b799bae06 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:29.859892 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-36747503-8779-4253-9957-493b799bae06 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f" status: 200 len: 1237 microversion: 2.1 time: 0.078879 Aug 31 12:34:29.861021 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 239/488] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:29 2022] GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f => generated 1237 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:34:30.881663 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-1e505767-67be-4303-9f15-a335c9116e6f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:30.882365 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-1e505767-67be-4303-9f15-a335c9116e6f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:30.888771 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1e505767-67be-4303-9f15-a335c9116e6f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:30.889253 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1e505767-67be-4303-9f15-a335c9116e6f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:30.889683 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1e505767-67be-4303-9f15-a335c9116e6f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:30.890371 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1e505767-67be-4303-9f15-a335c9116e6f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:30.890816 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1e505767-67be-4303-9f15-a335c9116e6f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:30.891263 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1e505767-67be-4303-9f15-a335c9116e6f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:31.087949 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-1e505767-67be-4303-9f15-a335c9116e6f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:31.099226 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-1e505767-67be-4303-9f15-a335c9116e6f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f" status: 200 len: 1289 microversion: 2.1 time: 0.218827 Aug 31 12:34:31.099981 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 250/489] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:30 2022] GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f => generated 1289 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:34:32.121791 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-f2e460c6-97c8-4cf7-a09f-5496b41ffe0f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:32.122401 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-f2e460c6-97c8-4cf7-a09f-5496b41ffe0f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:32.130314 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f2e460c6-97c8-4cf7-a09f-5496b41ffe0f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:32.130795 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f2e460c6-97c8-4cf7-a09f-5496b41ffe0f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:32.131242 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f2e460c6-97c8-4cf7-a09f-5496b41ffe0f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:32.131936 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f2e460c6-97c8-4cf7-a09f-5496b41ffe0f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:32.132379 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f2e460c6-97c8-4cf7-a09f-5496b41ffe0f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:32.132793 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f2e460c6-97c8-4cf7-a09f-5496b41ffe0f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:32.325739 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f2e460c6-97c8-4cf7-a09f-5496b41ffe0f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:32.334162 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-f2e460c6-97c8-4cf7-a09f-5496b41ffe0f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f" status: 200 len: 1362 microversion: 2.1 time: 0.216391 Aug 31 12:34:32.334720 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 240/490] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:32 2022] GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:34:32.614311 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-32cd4456-8c7c-4e85-9278-9b6e0e9a80ab req-05ea5177-35fe-4eb5-9fe1-6c1d48c7286e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c55128-ac55-4678-84c2-33c5ce3b426f", "tag": "551f8eda-257a-489c-852c-4480eabd8504"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:34:32.625071 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-32cd4456-8c7c-4e85-9278-9b6e0e9a80ab req-05ea5177-35fe-4eb5-9fe1-6c1d48c7286e service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:32.625546 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-32cd4456-8c7c-4e85-9278-9b6e0e9a80ab req-05ea5177-35fe-4eb5-9fe1-6c1d48c7286e service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:32.625985 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-32cd4456-8c7c-4e85-9278-9b6e0e9a80ab req-05ea5177-35fe-4eb5-9fe1-6c1d48c7286e service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:32.637337 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-32cd4456-8c7c-4e85-9278-9b6e0e9a80ab req-05ea5177-35fe-4eb5-9fe1-6c1d48c7286e service nova] Creating event network-changed:551f8eda-257a-489c-852c-4480eabd8504 for instance 03c55128-ac55-4678-84c2-33c5ce3b426f on hv-cinder-85528 Aug 31 12:34:32.642598 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-32cd4456-8c7c-4e85-9278-9b6e0e9a80ab req-05ea5177-35fe-4eb5-9fe1-6c1d48c7286e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032817 Aug 31 12:34:32.642959 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 251/491] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:34:33.356216 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-001cc788-661e-485e-b3db-bb72efe31de7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:33.356794 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-001cc788-661e-485e-b3db-bb72efe31de7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:33.363664 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-001cc788-661e-485e-b3db-bb72efe31de7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:33.364180 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-001cc788-661e-485e-b3db-bb72efe31de7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:33.364701 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-001cc788-661e-485e-b3db-bb72efe31de7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:33.365298 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-001cc788-661e-485e-b3db-bb72efe31de7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:33.365749 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-001cc788-661e-485e-b3db-bb72efe31de7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:33.366166 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-001cc788-661e-485e-b3db-bb72efe31de7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:33.499076 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-001cc788-661e-485e-b3db-bb72efe31de7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:33.507024 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-001cc788-661e-485e-b3db-bb72efe31de7 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f" status: 200 len: 1362 microversion: 2.1 time: 0.154662 Aug 31 12:34:33.507725 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 241/492] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:33 2022] GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:34:34.528601 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-ed9b4af7-7327-4956-8adc-f812a2079e61 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:34.529282 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-ed9b4af7-7327-4956-8adc-f812a2079e61 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:34.536063 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ed9b4af7-7327-4956-8adc-f812a2079e61 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:34.536543 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ed9b4af7-7327-4956-8adc-f812a2079e61 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:34.536967 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ed9b4af7-7327-4956-8adc-f812a2079e61 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:34.537675 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ed9b4af7-7327-4956-8adc-f812a2079e61 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:34.538114 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ed9b4af7-7327-4956-8adc-f812a2079e61 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:34.538530 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ed9b4af7-7327-4956-8adc-f812a2079e61 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:34.674421 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-ed9b4af7-7327-4956-8adc-f812a2079e61 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:34.682280 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-ed9b4af7-7327-4956-8adc-f812a2079e61 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f" status: 200 len: 1362 microversion: 2.1 time: 0.158243 Aug 31 12:34:34.682881 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 252/493] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:34 2022] GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:34:35.703955 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-dd3321de-4e78-479c-914d-de4324de7428 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:35.705282 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-dd3321de-4e78-479c-914d-de4324de7428 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:35.712076 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dd3321de-4e78-479c-914d-de4324de7428 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:35.712558 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dd3321de-4e78-479c-914d-de4324de7428 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:35.712985 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dd3321de-4e78-479c-914d-de4324de7428 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:35.713668 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dd3321de-4e78-479c-914d-de4324de7428 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:35.714112 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dd3321de-4e78-479c-914d-de4324de7428 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:35.714526 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dd3321de-4e78-479c-914d-de4324de7428 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:35.717280 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:34:35.854301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-dd3321de-4e78-479c-914d-de4324de7428 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:35.862608 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-dd3321de-4e78-479c-914d-de4324de7428 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f" status: 200 len: 1362 microversion: 2.1 time: 0.162558 Aug 31 12:34:35.863220 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 242/494] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:35 2022] GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:34:36.883490 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-abb2d97f-55d4-403a-bf09-38f894696135 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:36.884077 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-abb2d97f-55d4-403a-bf09-38f894696135 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:36.891454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-abb2d97f-55d4-403a-bf09-38f894696135 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:36.892563 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-abb2d97f-55d4-403a-bf09-38f894696135 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:36.893061 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-abb2d97f-55d4-403a-bf09-38f894696135 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:36.893849 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-abb2d97f-55d4-403a-bf09-38f894696135 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:36.894300 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-abb2d97f-55d4-403a-bf09-38f894696135 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:36.894719 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-abb2d97f-55d4-403a-bf09-38f894696135 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:37.025008 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-abb2d97f-55d4-403a-bf09-38f894696135 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:37.032641 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-abb2d97f-55d4-403a-bf09-38f894696135 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f" status: 200 len: 1362 microversion: 2.1 time: 0.152853 Aug 31 12:34:37.033215 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 253/495] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:36 2022] GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:34:37.230487 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-f8d86528-a47b-4f1b-b00d-ff9036e58715 req-1d4de56c-f991-4890-a4ac-98f1f3b7da72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c55128-ac55-4678-84c2-33c5ce3b426f", "name": "network-vif-plugged", "status": "completed", "tag": "551f8eda-257a-489c-852c-4480eabd8504"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:34:37.241558 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-f8d86528-a47b-4f1b-b00d-ff9036e58715 req-1d4de56c-f991-4890-a4ac-98f1f3b7da72 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:37.242516 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-f8d86528-a47b-4f1b-b00d-ff9036e58715 req-1d4de56c-f991-4890-a4ac-98f1f3b7da72 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:37.242985 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-f8d86528-a47b-4f1b-b00d-ff9036e58715 req-1d4de56c-f991-4890-a4ac-98f1f3b7da72 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:37.254809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-f8d86528-a47b-4f1b-b00d-ff9036e58715 req-1d4de56c-f991-4890-a4ac-98f1f3b7da72 service nova] Creating event network-vif-plugged:551f8eda-257a-489c-852c-4480eabd8504 for instance 03c55128-ac55-4678-84c2-33c5ce3b426f on hv-cinder-85528 Aug 31 12:34:37.260473 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-f8d86528-a47b-4f1b-b00d-ff9036e58715 req-1d4de56c-f991-4890-a4ac-98f1f3b7da72 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033283 Aug 31 12:34:37.261054 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 243/496] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:34:38.053733 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-5cf78f6d-929e-419b-90f2-191be229ca52 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:38.054359 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-5cf78f6d-929e-419b-90f2-191be229ca52 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:38.060817 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5cf78f6d-929e-419b-90f2-191be229ca52 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:38.061290 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5cf78f6d-929e-419b-90f2-191be229ca52 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:38.061722 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5cf78f6d-929e-419b-90f2-191be229ca52 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:38.062401 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5cf78f6d-929e-419b-90f2-191be229ca52 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:38.062844 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5cf78f6d-929e-419b-90f2-191be229ca52 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:38.063282 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5cf78f6d-929e-419b-90f2-191be229ca52 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:38.195071 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-5cf78f6d-929e-419b-90f2-191be229ca52 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:38.202821 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-5cf78f6d-929e-419b-90f2-191be229ca52 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f" status: 200 len: 1362 microversion: 2.1 time: 0.152986 Aug 31 12:34:38.203413 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 254/497] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:38 2022] GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:34:39.225023 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b5c2beac-dfe1-4a7e-9b43-1ff1fa4bd5e5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:39.225742 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-b5c2beac-dfe1-4a7e-9b43-1ff1fa4bd5e5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:39.234034 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b5c2beac-dfe1-4a7e-9b43-1ff1fa4bd5e5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:39.234522 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b5c2beac-dfe1-4a7e-9b43-1ff1fa4bd5e5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:39.234983 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b5c2beac-dfe1-4a7e-9b43-1ff1fa4bd5e5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:39.236180 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b5c2beac-dfe1-4a7e-9b43-1ff1fa4bd5e5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:39.236715 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b5c2beac-dfe1-4a7e-9b43-1ff1fa4bd5e5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:39.237235 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b5c2beac-dfe1-4a7e-9b43-1ff1fa4bd5e5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:39.371346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b5c2beac-dfe1-4a7e-9b43-1ff1fa4bd5e5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:39.379333 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b5c2beac-dfe1-4a7e-9b43-1ff1fa4bd5e5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f" status: 200 len: 1362 microversion: 2.1 time: 0.159047 Aug 31 12:34:39.380043 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 244/498] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:39 2022] GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:34:40.400567 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-ec2eef38-b7e5-4f3d-a983-f98ac55b8ad4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:40.401157 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-ec2eef38-b7e5-4f3d-a983-f98ac55b8ad4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:40.403612 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=2 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:34:40.404263 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=6 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:34:40.410230 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ec2eef38-b7e5-4f3d-a983-f98ac55b8ad4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:40.410713 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ec2eef38-b7e5-4f3d-a983-f98ac55b8ad4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:40.411176 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ec2eef38-b7e5-4f3d-a983-f98ac55b8ad4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:40.411855 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ec2eef38-b7e5-4f3d-a983-f98ac55b8ad4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:40.412301 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ec2eef38-b7e5-4f3d-a983-f98ac55b8ad4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:40.412719 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ec2eef38-b7e5-4f3d-a983-f98ac55b8ad4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:40.415466 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=73 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:34:40.543473 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-ec2eef38-b7e5-4f3d-a983-f98ac55b8ad4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:40.552055 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-ec2eef38-b7e5-4f3d-a983-f98ac55b8ad4 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f" status: 200 len: 1549 microversion: 2.1 time: 0.155309 Aug 31 12:34:40.552620 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 255/499] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:40 2022] GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:34:40.573171 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-d826f9a1-e181-4749-bf8d-fb54f5b46730 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:40.573730 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-d826f9a1-e181-4749-bf8d-fb54f5b46730 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:40.575602 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell0:SELECT=6 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:34:40.581609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d826f9a1-e181-4749-bf8d-fb54f5b46730 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:40.582094 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d826f9a1-e181-4749-bf8d-fb54f5b46730 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:40.582523 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d826f9a1-e181-4749-bf8d-fb54f5b46730 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:40.583241 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d826f9a1-e181-4749-bf8d-fb54f5b46730 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:40.583721 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d826f9a1-e181-4749-bf8d-fb54f5b46730 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:40.584145 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d826f9a1-e181-4749-bf8d-fb54f5b46730 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:40.669679 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-d826f9a1-e181-4749-bf8d-fb54f5b46730 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100405 Aug 31 12:34:40.670266 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 245/500] 10.222.0.79 () {58 vars in 1275 bytes} [Wed Aug 31 12:34:40 2022] GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:34:41.145986 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-e8f48319-69a8-486b-a7e3-4de4d32dd0cb tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:41.146481 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-e8f48319-69a8-486b-a7e3-4de4d32dd0cb tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:41.152641 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e8f48319-69a8-486b-a7e3-4de4d32dd0cb tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:41.153140 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e8f48319-69a8-486b-a7e3-4de4d32dd0cb tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:41.153580 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e8f48319-69a8-486b-a7e3-4de4d32dd0cb tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:41.154372 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e8f48319-69a8-486b-a7e3-4de4d32dd0cb tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:41.154922 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e8f48319-69a8-486b-a7e3-4de4d32dd0cb tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:41.155352 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e8f48319-69a8-486b-a7e3-4de4d32dd0cb tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:41.252810 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.objects.instance [None req-e8f48319-69a8-486b-a7e3-4de4d32dd0cb tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lazy-loading 'services' on Instance uuid 247cb5f7-647e-4e39-8a71-99a980f3e7f6 {{(pid=120749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:34:41.373150 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-e8f48319-69a8-486b-a7e3-4de4d32dd0cb tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "DELETE /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6/os-volume_attachments/6c1945ee-2958-41bc-ac34-4e44e5eb4f11" status: 202 len: 0 microversion: 2.1 time: 0.231528 Aug 31 12:34:41.373985 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 256/501] 10.222.0.79 () {58 vars in 1416 bytes} [Wed Aug 31 12:34:41 2022] DELETE /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6/os-volume_attachments/6c1945ee-2958-41bc-ac34-4e44e5eb4f11 => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:34:41.390395 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-f93dbc62-4b84-497a-8e76-9cffeef440c1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:41.397088 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-f93dbc62-4b84-497a-8e76-9cffeef440c1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:41.407215 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f93dbc62-4b84-497a-8e76-9cffeef440c1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:41.407800 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f93dbc62-4b84-497a-8e76-9cffeef440c1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:41.408383 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f93dbc62-4b84-497a-8e76-9cffeef440c1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:41.409117 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f93dbc62-4b84-497a-8e76-9cffeef440c1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:41.409573 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f93dbc62-4b84-497a-8e76-9cffeef440c1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:41.409994 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f93dbc62-4b84-497a-8e76-9cffeef440c1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:41.451467 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-f93dbc62-4b84-497a-8e76-9cffeef440c1 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072401 Aug 31 12:34:41.452231 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 246/502] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 31 12:34:41 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:34:41.669619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-e269dd10-d573-4da8-973b-8610fd6795b1 req-40287005-3293-4bc3-aa8d-907d9d164697 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c55128-ac55-4678-84c2-33c5ce3b426f", "tag": "551f8eda-257a-489c-852c-4480eabd8504"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:34:41.679964 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-e269dd10-d573-4da8-973b-8610fd6795b1 req-40287005-3293-4bc3-aa8d-907d9d164697 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:41.680442 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-e269dd10-d573-4da8-973b-8610fd6795b1 req-40287005-3293-4bc3-aa8d-907d9d164697 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:41.680865 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-e269dd10-d573-4da8-973b-8610fd6795b1 req-40287005-3293-4bc3-aa8d-907d9d164697 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:41.693538 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-e269dd10-d573-4da8-973b-8610fd6795b1 req-40287005-3293-4bc3-aa8d-907d9d164697 service nova] Creating event network-changed:551f8eda-257a-489c-852c-4480eabd8504 for instance 03c55128-ac55-4678-84c2-33c5ce3b426f on hv-cinder-85528 Aug 31 12:34:41.698597 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-e269dd10-d573-4da8-973b-8610fd6795b1 req-40287005-3293-4bc3-aa8d-907d9d164697 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033320 Aug 31 12:34:41.699332 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 257/503] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:34:42.466095 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b8d022f2-597f-426c-b4ad-8ba1dff26178 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:42.468960 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-b8d022f2-597f-426c-b4ad-8ba1dff26178 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:42.476890 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8d022f2-597f-426c-b4ad-8ba1dff26178 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:42.477388 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8d022f2-597f-426c-b4ad-8ba1dff26178 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:42.477857 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8d022f2-597f-426c-b4ad-8ba1dff26178 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:42.478609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8d022f2-597f-426c-b4ad-8ba1dff26178 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:42.479212 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8d022f2-597f-426c-b4ad-8ba1dff26178 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:42.479507 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8d022f2-597f-426c-b4ad-8ba1dff26178 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:42.513644 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b8d022f2-597f-426c-b4ad-8ba1dff26178 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052895 Aug 31 12:34:42.514229 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 247/504] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 31 12:34:42 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 12:34:42.605056 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-4b78c09f-9a78-4a65-ab15-d0657dfebfb9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:42.606088 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-4b78c09f-9a78-4a65-ab15-d0657dfebfb9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:42.614379 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4b78c09f-9a78-4a65-ab15-d0657dfebfb9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:42.614884 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4b78c09f-9a78-4a65-ab15-d0657dfebfb9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:42.615336 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4b78c09f-9a78-4a65-ab15-d0657dfebfb9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:42.616042 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4b78c09f-9a78-4a65-ab15-d0657dfebfb9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:42.616494 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4b78c09f-9a78-4a65-ab15-d0657dfebfb9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:42.616914 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4b78c09f-9a78-4a65-ab15-d0657dfebfb9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:42.644282 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-4b78c09f-9a78-4a65-ab15-d0657dfebfb9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Going to try to terminate instance {{(pid=120749) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:34:42.738251 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-4b78c09f-9a78-4a65-ab15-d0657dfebfb9 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "DELETE /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 204 len: 0 microversion: 2.1 time: 0.140819 Aug 31 12:34:42.739566 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 258/505] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 31 12:34:42 2022] DELETE /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:34:42.748549 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-6ff36dff-9891-42df-a008-63573621c270 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:42.749142 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-6ff36dff-9891-42df-a008-63573621c270 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:42.755745 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6ff36dff-9891-42df-a008-63573621c270 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:42.756233 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6ff36dff-9891-42df-a008-63573621c270 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:42.756864 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6ff36dff-9891-42df-a008-63573621c270 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:42.757746 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6ff36dff-9891-42df-a008-63573621c270 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:42.758199 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6ff36dff-9891-42df-a008-63573621c270 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:42.758619 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6ff36dff-9891-42df-a008-63573621c270 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:42.906145 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-6ff36dff-9891-42df-a008-63573621c270 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:42.913905 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-6ff36dff-9891-42df-a008-63573621c270 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1689 microversion: 2.1 time: 0.169383 Aug 31 12:34:42.914760 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 248/506] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:42 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:34:43.936035 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-b4faffce-380b-4956-8a36-152b542343b5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:43.936743 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-b4faffce-380b-4956-8a36-152b542343b5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:43.943593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b4faffce-380b-4956-8a36-152b542343b5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:43.944066 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b4faffce-380b-4956-8a36-152b542343b5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:43.944490 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b4faffce-380b-4956-8a36-152b542343b5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:43.945168 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b4faffce-380b-4956-8a36-152b542343b5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:43.945619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b4faffce-380b-4956-8a36-152b542343b5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:43.946033 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b4faffce-380b-4956-8a36-152b542343b5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:44.083429 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-b4faffce-380b-4956-8a36-152b542343b5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:44.091071 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-b4faffce-380b-4956-8a36-152b542343b5 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1689 microversion: 2.1 time: 0.159214 Aug 31 12:34:44.091669 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 259/507] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:43 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:34:45.113478 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-2136accc-c99e-43e7-bf96-fc4c10183b04 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:45.114092 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-2136accc-c99e-43e7-bf96-fc4c10183b04 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:45.121097 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2136accc-c99e-43e7-bf96-fc4c10183b04 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:45.121577 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2136accc-c99e-43e7-bf96-fc4c10183b04 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:45.122007 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2136accc-c99e-43e7-bf96-fc4c10183b04 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:45.122701 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2136accc-c99e-43e7-bf96-fc4c10183b04 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:45.123186 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2136accc-c99e-43e7-bf96-fc4c10183b04 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:45.123607 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2136accc-c99e-43e7-bf96-fc4c10183b04 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:45.251378 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-2136accc-c99e-43e7-bf96-fc4c10183b04 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:45.259162 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-2136accc-c99e-43e7-bf96-fc4c10183b04 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1689 microversion: 2.1 time: 0.150608 Aug 31 12:34:45.259723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 249/508] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:45 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:34:46.280807 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-db75b027-1cd2-4c3f-bf6f-2d3295b033b3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:46.281406 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-db75b027-1cd2-4c3f-bf6f-2d3295b033b3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:46.288743 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-db75b027-1cd2-4c3f-bf6f-2d3295b033b3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:46.289241 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-db75b027-1cd2-4c3f-bf6f-2d3295b033b3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:46.289678 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-db75b027-1cd2-4c3f-bf6f-2d3295b033b3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:46.290380 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-db75b027-1cd2-4c3f-bf6f-2d3295b033b3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:46.290833 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-db75b027-1cd2-4c3f-bf6f-2d3295b033b3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:46.291277 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-db75b027-1cd2-4c3f-bf6f-2d3295b033b3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:46.441314 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-db75b027-1cd2-4c3f-bf6f-2d3295b033b3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:46.449288 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-db75b027-1cd2-4c3f-bf6f-2d3295b033b3 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1689 microversion: 2.1 time: 0.172421 Aug 31 12:34:46.449805 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 260/509] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:46 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:34:47.348687 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-412db1f1-ac23-49ff-9e47-9220d5565bf3 req-621e2bab-a863-459c-9e9f-41743b97d72f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "247cb5f7-647e-4e39-8a71-99a980f3e7f6", "name": "network-vif-deleted", "tag": "3294c27b-cd99-416f-b4b3-6c18cb978a29"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:34:47.362086 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-412db1f1-ac23-49ff-9e47-9220d5565bf3 req-621e2bab-a863-459c-9e9f-41743b97d72f service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:47.362567 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-412db1f1-ac23-49ff-9e47-9220d5565bf3 req-621e2bab-a863-459c-9e9f-41743b97d72f service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:47.363212 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-412db1f1-ac23-49ff-9e47-9220d5565bf3 req-621e2bab-a863-459c-9e9f-41743b97d72f service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:47.376366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-412db1f1-ac23-49ff-9e47-9220d5565bf3 req-621e2bab-a863-459c-9e9f-41743b97d72f service nova] Creating event network-vif-deleted:3294c27b-cd99-416f-b4b3-6c18cb978a29 for instance 247cb5f7-647e-4e39-8a71-99a980f3e7f6 on hv-cinder-85528 Aug 31 12:34:47.381463 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-412db1f1-ac23-49ff-9e47-9220d5565bf3 req-621e2bab-a863-459c-9e9f-41743b97d72f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036994 Aug 31 12:34:47.382063 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 250/510] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:34:47.469720 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-0e575285-9ef0-4349-b444-72a1c79f3407 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:47.471063 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-0e575285-9ef0-4349-b444-72a1c79f3407 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:47.478699 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0e575285-9ef0-4349-b444-72a1c79f3407 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:47.479276 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0e575285-9ef0-4349-b444-72a1c79f3407 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:47.479712 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0e575285-9ef0-4349-b444-72a1c79f3407 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:47.480431 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0e575285-9ef0-4349-b444-72a1c79f3407 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:47.480891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0e575285-9ef0-4349-b444-72a1c79f3407 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:47.481312 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0e575285-9ef0-4349-b444-72a1c79f3407 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:47.530026 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0e575285-9ef0-4349-b444-72a1c79f3407 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:47.530790 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0e575285-9ef0-4349-b444-72a1c79f3407 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:47.531413 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0e575285-9ef0-4349-b444-72a1c79f3407 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:47.532263 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.objects.instance [None req-0e575285-9ef0-4349-b444-72a1c79f3407 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lazy-loading 'fault' on Instance uuid 247cb5f7-647e-4e39-8a71-99a980f3e7f6 {{(pid=120749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:34:47.604001 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-0e575285-9ef0-4349-b444-72a1c79f3407 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:47.634058 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-0e575285-9ef0-4349-b444-72a1c79f3407 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 200 len: 1335 microversion: 2.1 time: 0.164753 Aug 31 12:34:47.637756 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 261/511] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:47 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 1335 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:34:48.713368 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-09c6b1bb-efa5-46fe-887e-2b4c4b5bdb96 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:48.714067 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-09c6b1bb-efa5-46fe-887e-2b4c4b5bdb96 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 247cb5f7-647e-4e39-8a71-99a980f3e7f6] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:48.720872 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-09c6b1bb-efa5-46fe-887e-2b4c4b5bdb96 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:48.721369 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-09c6b1bb-efa5-46fe-887e-2b4c4b5bdb96 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:48.721808 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-09c6b1bb-efa5-46fe-887e-2b4c4b5bdb96 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:48.722496 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-09c6b1bb-efa5-46fe-887e-2b4c4b5bdb96 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:48.722975 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-09c6b1bb-efa5-46fe-887e-2b4c4b5bdb96 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:48.723401 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-09c6b1bb-efa5-46fe-887e-2b4c4b5bdb96 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:48.736688 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-09c6b1bb-efa5-46fe-887e-2b4c4b5bdb96 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] HTTP exception thrown: Instance 247cb5f7-647e-4e39-8a71-99a980f3e7f6 could not be found. Aug 31 12:34:48.738301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-09c6b1bb-efa5-46fe-887e-2b4c4b5bdb96 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Request method failure captured: Aug 31 12:34:48.738301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 HTTP/1.1 Aug 31 12:34:48.738301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:34:48.738301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:34:48.738301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:34:48.738301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 0 Aug 31 12:34:48.738301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:34:48.738301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:34:48.738301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:34:48.738301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:34:48.738301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1Q7JmiC9D834ocUdlCNr9HFRkA87wJ_FnUzJGxT5zTT8rU_zms7dDN50ARDsmwlrghc2tCu0r2wB4GfrFjOoimGbd6UfedSwZbznp9qT7fwLaJQHObEsIlJw2EeYd6b0WddqHNk8K0X0vyDMsTdb6In3CN19MqWaCjmEyAxCldxgtw Aug 31 12:34:48.738301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:34:48.738301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:34:48.738301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:34:48.738301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:34:48.738301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:34:48.738301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:34:48.738301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: 7327d2f6422e4bdb9e250e44987dace3 Aug 31 12:34:48.738301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-274391016 Aug 31 12:34:48.738301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:34:48.738301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:34:48.739996 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7327d2f6422e4bdb9e250e44987dace3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7327d2f6422e4bdb9e250e44987dace3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7327d2f6422e4bdb9e250e44987dace3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7327d2f6422e4bdb9e250e44987dace3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:34:48.739996 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-ServerRescueNegativeTestJSON-274391016 Aug 31 12:34:48.739996 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: 7327d2f6422e4bdb9e250e44987dace3 Aug 31 12:34:48.739996 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-274391016 Aug 31 12:34:48.739996 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-ServerRescueNegativeTestJSON-274391016-project Aug 31 12:34:48.739996 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:34:48.739996 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:34:48.739996 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: 64886d73c79649d1a824170a33f53fcb Aug 31 12:34:48.739996 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-ServerRescueNegativeTestJSON-274391016-project Aug 31 12:34:48.739996 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:34:48.739996 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Instance 247cb5f7-647e-4e39-8a71-99a980f3e7f6 could not be found. Aug 31 12:34:48.739996 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'id': '247cb5f7-647e-4e39-8a71-99a980f3e7f6'} Aug 31 12:34:48.740811 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:34:48.740811 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:34:48.740811 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:34:48.740811 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:34:48.740811 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:34:48.740811 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:34:48.740811 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:34:48.740811 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:34:48.740811 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:34:48.740811 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:34:48.740811 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 247cb5f7-647e-4e39-8a71-99a980f3e7f6 could not be found. Aug 31 12:34:48.740811 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:34:48.740811 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:34:48.740811 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:34:48.740811 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:34:48.740811 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:34:48.740811 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:34:48.740811 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:34:48.740811 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:34:48.740811 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:34:48.742023 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:34:48.742023 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:34:48.742023 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:34:48.742023 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:34:48.742023 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:34:48.742023 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:34:48.742023 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:34:48.742023 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 247cb5f7-647e-4e39-8a71-99a980f3e7f6 could not be found. Aug 31 12:34:48.742023 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:34:48.742023 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:34:48.742023 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:34:48.742023 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:34:48.742023 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:34:48.742023 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:34:48.742023 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:34:48.742023 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:34:48.742023 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 247cb5f7-647e-4e39-8a71-99a980f3e7f6 could not be found. Aug 31 12:34:48.742023 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:34:48.743166 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-09c6b1bb-efa5-46fe-887e-2b4c4b5bdb96 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Returning 404 to user: Instance 247cb5f7-647e-4e39-8a71-99a980f3e7f6 could not be found. {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:34:48.743166 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-09c6b1bb-efa5-46fe-887e-2b4c4b5bdb96 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6" status: 404 len: 111 microversion: 2.1 time: 0.084976 Aug 31 12:34:48.743166 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 251/512] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:48 2022] GET /compute/v2.1/servers/247cb5f7-647e-4e39-8a71-99a980f3e7f6 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:34:48.749099 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-31e6ab2e-fdfa-45c5-82f7-b26dd3fa031e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '.version_select at 0x7f8d17122ca0>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:48.771956 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-31e6ab2e-fdfa-45c5-82f7-b26dd3fa031e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1257648095" status: 202 len: 0 microversion: 2.1 time: 0.026953 Aug 31 12:34:48.772533 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 262/513] 10.222.0.79 () {58 vars in 1221 bytes} [Wed Aug 31 12:34:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1257648095 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:34:51.700241 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-f99f9a1a-d908-4791-ab23-ba0aace2a64f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:51.700775 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-f99f9a1a-d908-4791-ab23-ba0aace2a64f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:51.707633 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f99f9a1a-d908-4791-ab23-ba0aace2a64f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:51.708113 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f99f9a1a-d908-4791-ab23-ba0aace2a64f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:51.708547 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f99f9a1a-d908-4791-ab23-ba0aace2a64f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:51.709229 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f99f9a1a-d908-4791-ab23-ba0aace2a64f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:51.709682 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f99f9a1a-d908-4791-ab23-ba0aace2a64f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:51.710099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f99f9a1a-d908-4791-ab23-ba0aace2a64f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:51.735254 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-f99f9a1a-d908-4791-ab23-ba0aace2a64f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Going to try to terminate instance {{(pid=120750) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:34:51.812903 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-f99f9a1a-d908-4791-ab23-ba0aace2a64f tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "DELETE /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 204 len: 0 microversion: 2.1 time: 0.116306 Aug 31 12:34:51.813510 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 252/514] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 31 12:34:51 2022] DELETE /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:34:51.822501 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-ca7bf9d7-ba63-412e-8a55-6c5a90d7db7d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:51.823125 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-ca7bf9d7-ba63-412e-8a55-6c5a90d7db7d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:51.830429 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ca7bf9d7-ba63-412e-8a55-6c5a90d7db7d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:51.831029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ca7bf9d7-ba63-412e-8a55-6c5a90d7db7d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:51.831629 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ca7bf9d7-ba63-412e-8a55-6c5a90d7db7d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:51.832494 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ca7bf9d7-ba63-412e-8a55-6c5a90d7db7d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:51.832947 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ca7bf9d7-ba63-412e-8a55-6c5a90d7db7d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:51.833367 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ca7bf9d7-ba63-412e-8a55-6c5a90d7db7d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:51.968206 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-ca7bf9d7-ba63-412e-8a55-6c5a90d7db7d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:51.977454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-ca7bf9d7-ba63-412e-8a55-6c5a90d7db7d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1507 microversion: 2.1 time: 0.159710 Aug 31 12:34:51.978020 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 263/515] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:51 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:34:53.000551 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-6c26aed6-74de-4427-9dba-07848e8a2f04 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:53.001237 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-6c26aed6-74de-4427-9dba-07848e8a2f04 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:53.008484 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6c26aed6-74de-4427-9dba-07848e8a2f04 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:53.008968 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6c26aed6-74de-4427-9dba-07848e8a2f04 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:53.009404 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6c26aed6-74de-4427-9dba-07848e8a2f04 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:53.010097 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6c26aed6-74de-4427-9dba-07848e8a2f04 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:53.010547 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6c26aed6-74de-4427-9dba-07848e8a2f04 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:53.011000 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6c26aed6-74de-4427-9dba-07848e8a2f04 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:53.144674 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-6c26aed6-74de-4427-9dba-07848e8a2f04 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:53.152391 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-6c26aed6-74de-4427-9dba-07848e8a2f04 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1507 microversion: 2.1 time: 0.156255 Aug 31 12:34:53.153030 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 253/516] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:52 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:34:53.610729 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-d2212666-e40a-4945-9dab-89642af248c4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:53.611643 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-d2212666-e40a-4945-9dab-89642af248c4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:53.618446 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d2212666-e40a-4945-9dab-89642af248c4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:53.618962 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d2212666-e40a-4945-9dab-89642af248c4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:53.619395 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d2212666-e40a-4945-9dab-89642af248c4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:53.620085 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d2212666-e40a-4945-9dab-89642af248c4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:53.620535 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d2212666-e40a-4945-9dab-89642af248c4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:53.620961 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d2212666-e40a-4945-9dab-89642af248c4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:53.644240 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-d2212666-e40a-4945-9dab-89642af248c4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a/ips" status: 200 len: 153 microversion: 2.20 time: 0.091277 Aug 31 12:34:53.644859 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 264/517] 10.222.0.79 () {60 vars in 1289 bytes} [Wed Aug 31 12:34:53 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a/ips => generated 153 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:34:54.173569 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-8b5d9437-d24c-4c85-b17b-4d0d24a5fa27 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:54.174176 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-8b5d9437-d24c-4c85-b17b-4d0d24a5fa27 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:54.180849 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8b5d9437-d24c-4c85-b17b-4d0d24a5fa27 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:54.181329 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8b5d9437-d24c-4c85-b17b-4d0d24a5fa27 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:54.181786 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8b5d9437-d24c-4c85-b17b-4d0d24a5fa27 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:54.182450 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8b5d9437-d24c-4c85-b17b-4d0d24a5fa27 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:54.182928 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8b5d9437-d24c-4c85-b17b-4d0d24a5fa27 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:54.183353 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8b5d9437-d24c-4c85-b17b-4d0d24a5fa27 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:54.314505 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-8b5d9437-d24c-4c85-b17b-4d0d24a5fa27 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:54.323104 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-8b5d9437-d24c-4c85-b17b-4d0d24a5fa27 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1507 microversion: 2.1 time: 0.153424 Aug 31 12:34:54.323762 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 254/518] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:54 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:34:54.709780 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-4e398f56-f91d-4534-a28b-ba8735cb2362 req-78de9b17-1619-427a-9d4e-9e141a0a8e15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72fc3ffa-e316-44ad-8bd1-9767a06cf3ba", "name": "network-vif-deleted", "tag": "41eb7341-e106-4e13-a267-482be8b20f73"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:34:54.723272 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-4e398f56-f91d-4534-a28b-ba8735cb2362 req-78de9b17-1619-427a-9d4e-9e141a0a8e15 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:54.724566 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-4e398f56-f91d-4534-a28b-ba8735cb2362 req-78de9b17-1619-427a-9d4e-9e141a0a8e15 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:54.725184 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-4e398f56-f91d-4534-a28b-ba8735cb2362 req-78de9b17-1619-427a-9d4e-9e141a0a8e15 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:54.741308 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-4e398f56-f91d-4534-a28b-ba8735cb2362 req-78de9b17-1619-427a-9d4e-9e141a0a8e15 service nova] Creating event network-vif-deleted:41eb7341-e106-4e13-a267-482be8b20f73 for instance 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba on hv-cinder-85528 Aug 31 12:34:54.748227 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-4e398f56-f91d-4534-a28b-ba8735cb2362 req-78de9b17-1619-427a-9d4e-9e141a0a8e15 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043872 Aug 31 12:34:54.749217 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 265/519] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:34:55.344512 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-330c322e-e090-440c-8ac9-0d04d4e4347e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:55.345141 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-330c322e-e090-440c-8ac9-0d04d4e4347e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:55.352612 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-330c322e-e090-440c-8ac9-0d04d4e4347e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:55.353098 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-330c322e-e090-440c-8ac9-0d04d4e4347e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:55.353528 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-330c322e-e090-440c-8ac9-0d04d4e4347e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:55.354295 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-330c322e-e090-440c-8ac9-0d04d4e4347e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:55.354755 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-330c322e-e090-440c-8ac9-0d04d4e4347e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:55.355380 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-330c322e-e090-440c-8ac9-0d04d4e4347e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:55.389880 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-330c322e-e090-440c-8ac9-0d04d4e4347e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:55.390349 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-330c322e-e090-440c-8ac9-0d04d4e4347e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:55.390779 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-330c322e-e090-440c-8ac9-0d04d4e4347e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:55.391288 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.objects.instance [None req-330c322e-e090-440c-8ac9-0d04d4e4347e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lazy-loading 'fault' on Instance uuid 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba {{(pid=120750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:34:55.436464 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-330c322e-e090-440c-8ac9-0d04d4e4347e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:55.444473 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-330c322e-e090-440c-8ac9-0d04d4e4347e tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 200 len: 1312 microversion: 2.1 time: 0.103756 Aug 31 12:34:55.445048 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 255/520] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:55 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:34:56.111870 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-4ea4c4d8-c9c2-4613-949c-0f3c2e334c61 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:34:56.113066 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-4ea4c4d8-c9c2-4613-949c-0f3c2e334c61 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:56.119803 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4ea4c4d8-c9c2-4613-949c-0f3c2e334c61 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:56.120286 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4ea4c4d8-c9c2-4613-949c-0f3c2e334c61 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:56.120748 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4ea4c4d8-c9c2-4613-949c-0f3c2e334c61 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:56.121430 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4ea4c4d8-c9c2-4613-949c-0f3c2e334c61 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:56.121876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4ea4c4d8-c9c2-4613-949c-0f3c2e334c61 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:56.122290 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4ea4c4d8-c9c2-4613-949c-0f3c2e334c61 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:56.145471 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.objects.instance [None req-4ea4c4d8-c9c2-4613-949c-0f3c2e334c61 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lazy-loading 'flavor' on Instance uuid 8bee1640-e8d5-48a7-b437-414aac42397a {{(pid=120749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:34:56.324915 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-4ea4c4d8-c9c2-4613-949c-0f3c2e334c61 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "POST /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a/action" status: 202 len: 0 microversion: 2.20 time: 0.217816 Aug 31 12:34:56.325528 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 266/521] 10.222.0.79 () {62 vars in 1319 bytes} [Wed Aug 31 12:34:56 2022] POST /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:34:56.333738 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-0328b693-6c39-491c-b123-b851109ad045 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:56.334334 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-0328b693-6c39-491c-b123-b851109ad045 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:56.340338 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0328b693-6c39-491c-b123-b851109ad045 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:56.340816 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0328b693-6c39-491c-b123-b851109ad045 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:56.341245 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0328b693-6c39-491c-b123-b851109ad045 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:56.341929 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0328b693-6c39-491c-b123-b851109ad045 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:56.342372 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0328b693-6c39-491c-b123-b851109ad045 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:56.342790 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0328b693-6c39-491c-b123-b851109ad045 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:56.466499 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-05194cb1-942e-4170-a150-3fef7dd381e8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:56.467223 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-05194cb1-942e-4170-a150-3fef7dd381e8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:56.475117 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-05194cb1-942e-4170-a150-3fef7dd381e8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:56.475302 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-0328b693-6c39-491c-b123-b851109ad045 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:56.475724 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-05194cb1-942e-4170-a150-3fef7dd381e8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:56.476031 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-05194cb1-942e-4170-a150-3fef7dd381e8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:56.476721 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-05194cb1-942e-4170-a150-3fef7dd381e8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:56.477170 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-05194cb1-942e-4170-a150-3fef7dd381e8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:56.477586 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-05194cb1-942e-4170-a150-3fef7dd381e8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:56.483344 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-0328b693-6c39-491c-b123-b851109ad045 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:56.484771 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-0328b693-6c39-491c-b123-b851109ad045 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:56.485912 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-0328b693-6c39-491c-b123-b851109ad045 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1724 microversion: 2.20 time: 0.156158 Aug 31 12:34:56.486735 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 256/522] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:34:56 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:34:56.492309 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.wsgi [None req-05194cb1-942e-4170-a150-3fef7dd381e8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] HTTP exception thrown: Instance 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba could not be found. Aug 31 12:34:56.493876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-05194cb1-942e-4170-a150-3fef7dd381e8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Request method failure captured: Aug 31 12:34:56.493876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: request: GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba HTTP/1.1 Aug 31 12:34:56.493876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept: application/json Aug 31 12:34:56.493876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept-Encoding: identity Aug 31 12:34:56.493876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Connection: close Aug 31 12:34:56.493876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Length: 0 Aug 31 12:34:56.493876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Type: application/json Aug 31 12:34:56.493876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Host: 10.222.0.79 Aug 31 12:34:56.493876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Openstack-System-Scope: None Aug 31 12:34:56.493876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: User-Agent: python-urllib3/1.26.12 Aug 31 12:34:56.493876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Auth-Token: gAAAAABjD1Q7JmiC9D834ocUdlCNr9HFRkA87wJ_FnUzJGxT5zTT8rU_zms7dDN50ARDsmwlrghc2tCu0r2wB4GfrFjOoimGbd6UfedSwZbznp9qT7fwLaJQHObEsIlJw2EeYd6b0WddqHNk8K0X0vyDMsTdb6In3CN19MqWaCjmEyAxCldxgtw Aug 31 12:34:56.493876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Id: None Aug 31 12:34:56.493876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Name: None Aug 31 12:34:56.493876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Identity-Status: Confirmed Aug 31 12:34:56.493876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Is-Admin-Project: True Aug 31 12:34:56.493876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Id: default Aug 31 12:34:56.493876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Name: Default Aug 31 12:34:56.493876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Id: 7327d2f6422e4bdb9e250e44987dace3 Aug 31 12:34:56.493876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-274391016 Aug 31 12:34:56.493876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Role: reader,member Aug 31 12:34:56.493876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Roles: reader,member Aug 31 12:34:56.495625 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7327d2f6422e4bdb9e250e44987dace3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7327d2f6422e4bdb9e250e44987dace3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7327d2f6422e4bdb9e250e44987dace3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7327d2f6422e4bdb9e250e44987dace3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:34:56.495625 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant: tempest-ServerRescueNegativeTestJSON-274391016 Aug 31 12:34:56.495625 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Id: 7327d2f6422e4bdb9e250e44987dace3 Aug 31 12:34:56.495625 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-274391016 Aug 31 12:34:56.495625 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User: tempest-ServerRescueNegativeTestJSON-274391016-project Aug 31 12:34:56.495625 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Id: default Aug 31 12:34:56.495625 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Name: Default Aug 31 12:34:56.495625 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Id: 64886d73c79649d1a824170a33f53fcb Aug 31 12:34:56.495625 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Name: tempest-ServerRescueNegativeTestJSON-274391016-project Aug 31 12:34:56.495625 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: method: > Aug 31 12:34:56.495625 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: exception: Instance 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba could not be found. Aug 31 12:34:56.495625 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: action_args: {'id': '72fc3ffa-e316-44ad-8bd1-9767a06cf3ba'} Aug 31 12:34:56.496821 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:34:56.496821 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:34:56.496821 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:34:56.496821 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:34:56.496821 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:34:56.496821 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:34:56.496821 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:34:56.496821 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:34:56.496821 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:34:56.496821 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:34:56.496821 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba could not be found. Aug 31 12:34:56.496821 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:34:56.496821 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:34:56.496821 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:34:56.496821 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:34:56.496821 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:34:56.496821 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:34:56.496821 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:34:56.496821 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:34:56.496821 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:34:56.498376 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:34:56.498376 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:34:56.498376 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:34:56.498376 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:34:56.498376 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:34:56.498376 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:34:56.498376 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:34:56.498376 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba could not be found. Aug 31 12:34:56.498376 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:34:56.498376 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:34:56.498376 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:34:56.498376 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:34:56.498376 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:34:56.498376 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:34:56.498376 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:34:56.498376 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:34:56.498376 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba could not be found. Aug 31 12:34:56.498376 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:34:56.500890 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-05194cb1-942e-4170-a150-3fef7dd381e8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Returning 404 to user: Instance 72fc3ffa-e316-44ad-8bd1-9767a06cf3ba could not be found. {{(pid=120749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:34:56.500890 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-05194cb1-942e-4170-a150-3fef7dd381e8 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba" status: 404 len: 111 microversion: 2.1 time: 0.033077 Aug 31 12:34:56.500890 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 267/523] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:56 2022] GET /compute/v2.1/servers/72fc3ffa-e316-44ad-8bd1-9767a06cf3ba => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:34:56.503702 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-ba308a67-3f9a-4d3e-a0cf-f9ab2fe1a0af tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:56.504218 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-ba308a67-3f9a-4d3e-a0cf-f9ab2fe1a0af tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:56.510204 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ba308a67-3f9a-4d3e-a0cf-f9ab2fe1a0af tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:56.510682 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ba308a67-3f9a-4d3e-a0cf-f9ab2fe1a0af tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:56.511140 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ba308a67-3f9a-4d3e-a0cf-f9ab2fe1a0af tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:56.511821 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ba308a67-3f9a-4d3e-a0cf-f9ab2fe1a0af tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:56.512271 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ba308a67-3f9a-4d3e-a0cf-f9ab2fe1a0af tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:56.512687 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ba308a67-3f9a-4d3e-a0cf-f9ab2fe1a0af tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:56.537310 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-ba308a67-3f9a-4d3e-a0cf-f9ab2fe1a0af tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Going to try to terminate instance {{(pid=120750) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:34:56.582541 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:34:56.613929 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-ba308a67-3f9a-4d3e-a0cf-f9ab2fe1a0af tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 204 len: 0 microversion: 2.1 time: 0.113596 Aug 31 12:34:56.614959 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 257/524] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 31 12:34:56 2022] DELETE /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:34:56.624861 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-5110805f-4a83-4308-a7a0-bd0c4a202859 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:56.625476 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-5110805f-4a83-4308-a7a0-bd0c4a202859 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:56.632224 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5110805f-4a83-4308-a7a0-bd0c4a202859 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:56.632719 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5110805f-4a83-4308-a7a0-bd0c4a202859 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:56.633188 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5110805f-4a83-4308-a7a0-bd0c4a202859 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:56.633914 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5110805f-4a83-4308-a7a0-bd0c4a202859 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:56.634370 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5110805f-4a83-4308-a7a0-bd0c4a202859 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:56.634796 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5110805f-4a83-4308-a7a0-bd0c4a202859 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:56.775010 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-5110805f-4a83-4308-a7a0-bd0c4a202859 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:56.783094 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-5110805f-4a83-4308-a7a0-bd0c4a202859 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1521 microversion: 2.1 time: 0.164217 Aug 31 12:34:56.783678 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 268/525] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:56 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:34:57.510068 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-01b7dcf9-9173-4ff2-8ca8-28ddaa0121d0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:57.510766 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-01b7dcf9-9173-4ff2-8ca8-28ddaa0121d0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:57.517154 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-01b7dcf9-9173-4ff2-8ca8-28ddaa0121d0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:57.517632 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-01b7dcf9-9173-4ff2-8ca8-28ddaa0121d0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:57.518068 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-01b7dcf9-9173-4ff2-8ca8-28ddaa0121d0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:57.519334 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-01b7dcf9-9173-4ff2-8ca8-28ddaa0121d0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:57.519863 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-01b7dcf9-9173-4ff2-8ca8-28ddaa0121d0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:57.520281 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-01b7dcf9-9173-4ff2-8ca8-28ddaa0121d0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:57.657814 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-01b7dcf9-9173-4ff2-8ca8-28ddaa0121d0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:57.667862 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-01b7dcf9-9173-4ff2-8ca8-28ddaa0121d0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:57.669292 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-01b7dcf9-9173-4ff2-8ca8-28ddaa0121d0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:57.670453 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-01b7dcf9-9173-4ff2-8ca8-28ddaa0121d0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1724 microversion: 2.20 time: 0.164701 Aug 31 12:34:57.671041 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 258/526] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:34:57 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:34:57.804454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-54274f2b-f0d0-42a7-923c-e44640e4105c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:57.805085 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-54274f2b-f0d0-42a7-923c-e44640e4105c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:57.811870 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-54274f2b-f0d0-42a7-923c-e44640e4105c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:57.812359 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-54274f2b-f0d0-42a7-923c-e44640e4105c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:57.812794 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-54274f2b-f0d0-42a7-923c-e44640e4105c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:57.813484 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-54274f2b-f0d0-42a7-923c-e44640e4105c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:57.813941 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-54274f2b-f0d0-42a7-923c-e44640e4105c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:57.814355 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-54274f2b-f0d0-42a7-923c-e44640e4105c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:57.947174 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-54274f2b-f0d0-42a7-923c-e44640e4105c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:57.954956 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-54274f2b-f0d0-42a7-923c-e44640e4105c tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1521 microversion: 2.1 time: 0.154421 Aug 31 12:34:57.955521 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 269/527] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:57 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:34:58.693822 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-cbf36762-e692-4e3d-94e9-87f110e38876 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:58.694435 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-cbf36762-e692-4e3d-94e9-87f110e38876 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:58.696968 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:34:58.702264 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cbf36762-e692-4e3d-94e9-87f110e38876 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:58.703155 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cbf36762-e692-4e3d-94e9-87f110e38876 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:58.703155 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cbf36762-e692-4e3d-94e9-87f110e38876 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:58.704057 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cbf36762-e692-4e3d-94e9-87f110e38876 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:58.704640 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cbf36762-e692-4e3d-94e9-87f110e38876 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:58.705062 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cbf36762-e692-4e3d-94e9-87f110e38876 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:58.976728 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-e76cf37a-b11f-45b7-8922-e7cbc2c7e600 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:34:58.977292 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-e76cf37a-b11f-45b7-8922-e7cbc2c7e600 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:34:58.983870 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e76cf37a-b11f-45b7-8922-e7cbc2c7e600 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:58.984394 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e76cf37a-b11f-45b7-8922-e7cbc2c7e600 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:58.984835 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e76cf37a-b11f-45b7-8922-e7cbc2c7e600 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:58.985557 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e76cf37a-b11f-45b7-8922-e7cbc2c7e600 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:34:58.986391 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e76cf37a-b11f-45b7-8922-e7cbc2c7e600 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:34:58.986843 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e76cf37a-b11f-45b7-8922-e7cbc2c7e600 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:34:59.004508 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:34:59.046987 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-cbf36762-e692-4e3d-94e9-87f110e38876 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:59.055954 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-cbf36762-e692-4e3d-94e9-87f110e38876 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:59.057397 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-cbf36762-e692-4e3d-94e9-87f110e38876 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:59.058591 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-cbf36762-e692-4e3d-94e9-87f110e38876 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1724 microversion: 2.20 time: 0.369694 Aug 31 12:34:59.059202 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 259/528] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:34:58 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1724 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:34:59.124020 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-e76cf37a-b11f-45b7-8922-e7cbc2c7e600 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:34:59.131735 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-e76cf37a-b11f-45b7-8922-e7cbc2c7e600 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1521 microversion: 2.1 time: 0.159053 Aug 31 12:34:59.132289 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 270/529] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:34:58 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:00.081091 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-0c9f944c-a37b-492b-a240-319366e60769 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:00.082513 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-0c9f944c-a37b-492b-a240-319366e60769 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:00.089173 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0c9f944c-a37b-492b-a240-319366e60769 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:00.089656 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0c9f944c-a37b-492b-a240-319366e60769 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:00.090102 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0c9f944c-a37b-492b-a240-319366e60769 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:00.090802 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0c9f944c-a37b-492b-a240-319366e60769 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:00.091283 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0c9f944c-a37b-492b-a240-319366e60769 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:00.091697 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0c9f944c-a37b-492b-a240-319366e60769 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:00.153520 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-dea10195-575d-4dee-b34b-7bb2631c1fd7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:00.154426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-dea10195-575d-4dee-b34b-7bb2631c1fd7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:00.156636 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:00.164137 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-dea10195-575d-4dee-b34b-7bb2631c1fd7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:00.164615 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-dea10195-575d-4dee-b34b-7bb2631c1fd7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:00.165000 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-dea10195-575d-4dee-b34b-7bb2631c1fd7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:00.165782 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-dea10195-575d-4dee-b34b-7bb2631c1fd7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:00.166192 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-dea10195-575d-4dee-b34b-7bb2631c1fd7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:00.167111 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-dea10195-575d-4dee-b34b-7bb2631c1fd7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:00.246965 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-0c9f944c-a37b-492b-a240-319366e60769 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:00.256893 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-0c9f944c-a37b-492b-a240-319366e60769 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:00.258354 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-0c9f944c-a37b-492b-a240-319366e60769 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:00.259632 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-0c9f944c-a37b-492b-a240-319366e60769 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1724 microversion: 2.20 time: 0.182464 Aug 31 12:35:00.260376 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 260/530] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:00 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:00.531572 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-dea10195-575d-4dee-b34b-7bb2631c1fd7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:00.546835 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-dea10195-575d-4dee-b34b-7bb2631c1fd7 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1521 microversion: 2.1 time: 0.396956 Aug 31 12:35:00.548127 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 271/531] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:00 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1521 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:01.089054 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-de9ea87a-1a92-4de7-bfc6-878cd7eeb164 req-b8006455-6ba6-4ce3-b35f-73048689d86d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbae24ec-b404-415c-97a7-a78cd28ff068", "name": "network-vif-deleted", "tag": "beb6c22d-2e33-4df9-bc8d-b813944abaf7"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:35:01.102196 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-de9ea87a-1a92-4de7-bfc6-878cd7eeb164 req-b8006455-6ba6-4ce3-b35f-73048689d86d service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:01.103069 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-de9ea87a-1a92-4de7-bfc6-878cd7eeb164 req-b8006455-6ba6-4ce3-b35f-73048689d86d service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:01.103778 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-de9ea87a-1a92-4de7-bfc6-878cd7eeb164 req-b8006455-6ba6-4ce3-b35f-73048689d86d service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:01.123852 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-de9ea87a-1a92-4de7-bfc6-878cd7eeb164 req-b8006455-6ba6-4ce3-b35f-73048689d86d service nova] Creating event network-vif-deleted:beb6c22d-2e33-4df9-bc8d-b813944abaf7 for instance bbae24ec-b404-415c-97a7-a78cd28ff068 on hv-cinder-85528 Aug 31 12:35:01.130331 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-de9ea87a-1a92-4de7-bfc6-878cd7eeb164 req-b8006455-6ba6-4ce3-b35f-73048689d86d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045043 Aug 31 12:35:01.131187 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 261/532] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:35:01.283891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-893b1d05-3cab-490e-9f28-20122d740b00 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:01.285325 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-893b1d05-3cab-490e-9f28-20122d740b00 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:01.293160 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-893b1d05-3cab-490e-9f28-20122d740b00 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:01.294084 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-893b1d05-3cab-490e-9f28-20122d740b00 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:01.294742 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-893b1d05-3cab-490e-9f28-20122d740b00 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:01.295562 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-893b1d05-3cab-490e-9f28-20122d740b00 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:01.296088 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-893b1d05-3cab-490e-9f28-20122d740b00 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:01.296583 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-893b1d05-3cab-490e-9f28-20122d740b00 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:01.449377 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-893b1d05-3cab-490e-9f28-20122d740b00 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:01.458889 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-893b1d05-3cab-490e-9f28-20122d740b00 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:01.460349 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-893b1d05-3cab-490e-9f28-20122d740b00 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:01.461545 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-893b1d05-3cab-490e-9f28-20122d740b00 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1724 microversion: 2.20 time: 0.181678 Aug 31 12:35:01.462110 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 272/533] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:01 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:01.569975 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-1ce8b681-785c-428f-a067-86f19a8d6148 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:01.570672 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-1ce8b681-785c-428f-a067-86f19a8d6148 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:01.577573 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1ce8b681-785c-428f-a067-86f19a8d6148 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:01.578062 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1ce8b681-785c-428f-a067-86f19a8d6148 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:01.578498 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1ce8b681-785c-428f-a067-86f19a8d6148 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:01.579273 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1ce8b681-785c-428f-a067-86f19a8d6148 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:01.579736 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1ce8b681-785c-428f-a067-86f19a8d6148 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:01.580161 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1ce8b681-785c-428f-a067-86f19a8d6148 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:01.616232 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1ce8b681-785c-428f-a067-86f19a8d6148 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:01.616633 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1ce8b681-785c-428f-a067-86f19a8d6148 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:01.617068 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1ce8b681-785c-428f-a067-86f19a8d6148 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:01.617511 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.objects.instance [None req-1ce8b681-785c-428f-a067-86f19a8d6148 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lazy-loading 'fault' on Instance uuid bbae24ec-b404-415c-97a7-a78cd28ff068 {{(pid=120750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:35:01.663281 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-1ce8b681-785c-428f-a067-86f19a8d6148 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64886d73c79649d1a824170a33f53fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7327d2f6422e4bdb9e250e44987dace3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:01.672385 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-1ce8b681-785c-428f-a067-86f19a8d6148 tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 200 len: 1312 microversion: 2.1 time: 0.107277 Aug 31 12:35:01.673134 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 262/534] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:01 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:02.484391 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-a533fef0-1175-40c1-9ecb-a3f81f1a5645 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:02.485060 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-a533fef0-1175-40c1-9ecb-a3f81f1a5645 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:02.492447 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a533fef0-1175-40c1-9ecb-a3f81f1a5645 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:02.493027 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a533fef0-1175-40c1-9ecb-a3f81f1a5645 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:02.493365 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a533fef0-1175-40c1-9ecb-a3f81f1a5645 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:02.494333 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a533fef0-1175-40c1-9ecb-a3f81f1a5645 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:02.495090 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a533fef0-1175-40c1-9ecb-a3f81f1a5645 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:02.495090 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a533fef0-1175-40c1-9ecb-a3f81f1a5645 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:02.626594 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-a533fef0-1175-40c1-9ecb-a3f81f1a5645 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:02.634826 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-a533fef0-1175-40c1-9ecb-a3f81f1a5645 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:02.636283 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-a533fef0-1175-40c1-9ecb-a3f81f1a5645 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:02.637431 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-a533fef0-1175-40c1-9ecb-a3f81f1a5645 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1724 microversion: 2.20 time: 0.157124 Aug 31 12:35:02.637986 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 273/535] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:02 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:02.694277 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-e5121ea3-5961-45f0-85f0-ff3e8c4c026d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:02.694984 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-e5121ea3-5961-45f0-85f0-ff3e8c4c026d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] [instance: bbae24ec-b404-415c-97a7-a78cd28ff068] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:02.701308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e5121ea3-5961-45f0-85f0-ff3e8c4c026d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:02.701792 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e5121ea3-5961-45f0-85f0-ff3e8c4c026d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:02.702215 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e5121ea3-5961-45f0-85f0-ff3e8c4c026d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:02.702914 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e5121ea3-5961-45f0-85f0-ff3e8c4c026d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:02.703366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e5121ea3-5961-45f0-85f0-ff3e8c4c026d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:02.703780 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e5121ea3-5961-45f0-85f0-ff3e8c4c026d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:02.719398 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-e5121ea3-5961-45f0-85f0-ff3e8c4c026d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] HTTP exception thrown: Instance bbae24ec-b404-415c-97a7-a78cd28ff068 could not be found. Aug 31 12:35:02.720990 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-e5121ea3-5961-45f0-85f0-ff3e8c4c026d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Request method failure captured: Aug 31 12:35:02.720990 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 HTTP/1.1 Aug 31 12:35:02.720990 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:35:02.720990 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:35:02.720990 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:35:02.720990 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 0 Aug 31 12:35:02.720990 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:35:02.720990 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:35:02.720990 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:35:02.720990 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:35:02.720990 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1Q7JmiC9D834ocUdlCNr9HFRkA87wJ_FnUzJGxT5zTT8rU_zms7dDN50ARDsmwlrghc2tCu0r2wB4GfrFjOoimGbd6UfedSwZbznp9qT7fwLaJQHObEsIlJw2EeYd6b0WddqHNk8K0X0vyDMsTdb6In3CN19MqWaCjmEyAxCldxgtw Aug 31 12:35:02.720990 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:35:02.720990 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:35:02.720990 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:35:02.720990 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:35:02.720990 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:35:02.720990 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:35:02.720990 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: 7327d2f6422e4bdb9e250e44987dace3 Aug 31 12:35:02.720990 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-274391016 Aug 31 12:35:02.720990 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:35:02.720990 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:35:02.723291 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7327d2f6422e4bdb9e250e44987dace3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7327d2f6422e4bdb9e250e44987dace3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7327d2f6422e4bdb9e250e44987dace3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7327d2f6422e4bdb9e250e44987dace3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:35:02.723291 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-ServerRescueNegativeTestJSON-274391016 Aug 31 12:35:02.723291 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: 7327d2f6422e4bdb9e250e44987dace3 Aug 31 12:35:02.723291 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-274391016 Aug 31 12:35:02.723291 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-ServerRescueNegativeTestJSON-274391016-project Aug 31 12:35:02.723291 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:35:02.723291 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:35:02.723291 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: 64886d73c79649d1a824170a33f53fcb Aug 31 12:35:02.723291 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-ServerRescueNegativeTestJSON-274391016-project Aug 31 12:35:02.723291 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:35:02.723291 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Instance bbae24ec-b404-415c-97a7-a78cd28ff068 could not be found. Aug 31 12:35:02.723291 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'id': 'bbae24ec-b404-415c-97a7-a78cd28ff068'} Aug 31 12:35:02.724385 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:35:02.724385 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:35:02.724385 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:35:02.724385 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:35:02.724385 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:35:02.724385 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:35:02.724385 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:35:02.724385 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:35:02.724385 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:35:02.724385 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:35:02.724385 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbae24ec-b404-415c-97a7-a78cd28ff068 could not be found. Aug 31 12:35:02.724385 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:35:02.724385 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:35:02.724385 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:35:02.724385 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:35:02.724385 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:35:02.724385 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:35:02.724385 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:35:02.724385 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:35:02.724385 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:35:02.725818 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:35:02.725818 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:35:02.725818 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:35:02.725818 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:35:02.725818 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:35:02.725818 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:35:02.725818 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:35:02.725818 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbae24ec-b404-415c-97a7-a78cd28ff068 could not be found. Aug 31 12:35:02.725818 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:35:02.725818 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:35:02.725818 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:35:02.725818 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:35:02.725818 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:35:02.725818 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:35:02.725818 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:35:02.725818 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:35:02.725818 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbae24ec-b404-415c-97a7-a78cd28ff068 could not be found. Aug 31 12:35:02.725818 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:35:02.727446 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-e5121ea3-5961-45f0-85f0-ff3e8c4c026d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] Returning 404 to user: Instance bbae24ec-b404-415c-97a7-a78cd28ff068 could not be found. {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:35:02.727446 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-e5121ea3-5961-45f0-85f0-ff3e8c4c026d tempest-ServerRescueNegativeTestJSON-274391016 tempest-ServerRescueNegativeTestJSON-274391016-project] 10.222.0.79 "GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068" status: 404 len: 111 microversion: 2.1 time: 0.032725 Aug 31 12:35:02.727446 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 263/536] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:02 2022] GET /compute/v2.1/servers/bbae24ec-b404-415c-97a7-a78cd28ff068 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:35:03.662230 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-489fc988-8388-419e-a97d-e2ca580fd5ec tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:03.662970 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-489fc988-8388-419e-a97d-e2ca580fd5ec tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:03.669553 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-489fc988-8388-419e-a97d-e2ca580fd5ec tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:03.670107 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-489fc988-8388-419e-a97d-e2ca580fd5ec tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:03.670547 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-489fc988-8388-419e-a97d-e2ca580fd5ec tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:03.671271 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-489fc988-8388-419e-a97d-e2ca580fd5ec tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:03.671726 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-489fc988-8388-419e-a97d-e2ca580fd5ec tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:03.672147 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-489fc988-8388-419e-a97d-e2ca580fd5ec tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:03.887317 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-489fc988-8388-419e-a97d-e2ca580fd5ec tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:03.896694 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-489fc988-8388-419e-a97d-e2ca580fd5ec tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:03.898117 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-489fc988-8388-419e-a97d-e2ca580fd5ec tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:03.899693 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-489fc988-8388-419e-a97d-e2ca580fd5ec tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1724 microversion: 2.20 time: 0.242162 Aug 31 12:35:03.900208 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 274/537] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:03 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:04.922823 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-39800636-20d8-4138-b937-e7bc01d4e7e0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:04.924527 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-39800636-20d8-4138-b937-e7bc01d4e7e0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:04.932073 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-39800636-20d8-4138-b937-e7bc01d4e7e0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:04.932554 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-39800636-20d8-4138-b937-e7bc01d4e7e0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:04.933207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-39800636-20d8-4138-b937-e7bc01d4e7e0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:04.933974 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-39800636-20d8-4138-b937-e7bc01d4e7e0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:04.934427 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-39800636-20d8-4138-b937-e7bc01d4e7e0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:04.934837 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-39800636-20d8-4138-b937-e7bc01d4e7e0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:05.111215 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-39800636-20d8-4138-b937-e7bc01d4e7e0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:05.120365 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-39800636-20d8-4138-b937-e7bc01d4e7e0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:05.121750 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-39800636-20d8-4138-b937-e7bc01d4e7e0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:05.122951 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-39800636-20d8-4138-b937-e7bc01d4e7e0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1724 microversion: 2.20 time: 0.204091 Aug 31 12:35:05.123510 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 264/538] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:04 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:06.147248 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-8819824f-fe7c-413d-8bd4-d801dc72fed1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:06.147984 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-8819824f-fe7c-413d-8bd4-d801dc72fed1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:06.155301 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8819824f-fe7c-413d-8bd4-d801dc72fed1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:06.155798 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8819824f-fe7c-413d-8bd4-d801dc72fed1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:06.156247 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8819824f-fe7c-413d-8bd4-d801dc72fed1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:06.157389 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8819824f-fe7c-413d-8bd4-d801dc72fed1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:06.158331 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8819824f-fe7c-413d-8bd4-d801dc72fed1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:06.163172 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8819824f-fe7c-413d-8bd4-d801dc72fed1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:06.419222 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8819824f-fe7c-413d-8bd4-d801dc72fed1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:06.427262 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8819824f-fe7c-413d-8bd4-d801dc72fed1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:06.428720 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8819824f-fe7c-413d-8bd4-d801dc72fed1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:06.429868 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-8819824f-fe7c-413d-8bd4-d801dc72fed1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1724 microversion: 2.20 time: 0.288197 Aug 31 12:35:06.430419 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 275/539] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:06 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1724 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:07.453233 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-6cce3d7c-b1da-49ac-b731-202d1b4ffc4e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:07.453782 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-6cce3d7c-b1da-49ac-b731-202d1b4ffc4e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:07.460796 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6cce3d7c-b1da-49ac-b731-202d1b4ffc4e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:07.461276 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6cce3d7c-b1da-49ac-b731-202d1b4ffc4e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:07.461737 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6cce3d7c-b1da-49ac-b731-202d1b4ffc4e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:07.462398 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6cce3d7c-b1da-49ac-b731-202d1b4ffc4e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:07.462843 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6cce3d7c-b1da-49ac-b731-202d1b4ffc4e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:07.463292 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6cce3d7c-b1da-49ac-b731-202d1b4ffc4e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:07.594974 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-6cce3d7c-b1da-49ac-b731-202d1b4ffc4e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:07.603368 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-6cce3d7c-b1da-49ac-b731-202d1b4ffc4e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:07.604790 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-6cce3d7c-b1da-49ac-b731-202d1b4ffc4e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:07.605941 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-6cce3d7c-b1da-49ac-b731-202d1b4ffc4e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1724 microversion: 2.20 time: 0.156784 Aug 31 12:35:07.606479 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 265/540] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:07 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:08.630056 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-94c475cb-c46e-4968-82ef-fdd8bbad7e80 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:08.630950 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-94c475cb-c46e-4968-82ef-fdd8bbad7e80 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:08.645060 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-94c475cb-c46e-4968-82ef-fdd8bbad7e80 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:08.645827 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-94c475cb-c46e-4968-82ef-fdd8bbad7e80 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:08.646552 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-94c475cb-c46e-4968-82ef-fdd8bbad7e80 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:08.647511 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-94c475cb-c46e-4968-82ef-fdd8bbad7e80 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:08.648375 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-94c475cb-c46e-4968-82ef-fdd8bbad7e80 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:08.649061 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-94c475cb-c46e-4968-82ef-fdd8bbad7e80 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:08.912784 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-94c475cb-c46e-4968-82ef-fdd8bbad7e80 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:08.926985 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-94c475cb-c46e-4968-82ef-fdd8bbad7e80 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:08.928982 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-94c475cb-c46e-4968-82ef-fdd8bbad7e80 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:08.930257 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-94c475cb-c46e-4968-82ef-fdd8bbad7e80 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1724 microversion: 2.20 time: 0.304476 Aug 31 12:35:08.931208 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 276/541] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:08 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1724 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:09.955153 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b51ee6e7-f9ab-4a58-9f8d-97731fa7b411 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:09.956503 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-b51ee6e7-f9ab-4a58-9f8d-97731fa7b411 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:09.963803 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b51ee6e7-f9ab-4a58-9f8d-97731fa7b411 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:09.964291 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b51ee6e7-f9ab-4a58-9f8d-97731fa7b411 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:09.964717 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b51ee6e7-f9ab-4a58-9f8d-97731fa7b411 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:09.965405 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b51ee6e7-f9ab-4a58-9f8d-97731fa7b411 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:09.966028 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b51ee6e7-f9ab-4a58-9f8d-97731fa7b411 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:09.966444 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b51ee6e7-f9ab-4a58-9f8d-97731fa7b411 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:10.136160 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b51ee6e7-f9ab-4a58-9f8d-97731fa7b411 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:10.145849 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b51ee6e7-f9ab-4a58-9f8d-97731fa7b411 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:10.147773 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b51ee6e7-f9ab-4a58-9f8d-97731fa7b411 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:10.149245 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b51ee6e7-f9ab-4a58-9f8d-97731fa7b411 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1724 microversion: 2.20 time: 0.198102 Aug 31 12:35:10.151595 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 266/542] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:09 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:11.199610 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-1123b57a-da8c-4d43-854e-09a953d8a428 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:11.205511 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-1123b57a-da8c-4d43-854e-09a953d8a428 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:11.221023 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1123b57a-da8c-4d43-854e-09a953d8a428 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:11.222504 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1123b57a-da8c-4d43-854e-09a953d8a428 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:11.223559 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1123b57a-da8c-4d43-854e-09a953d8a428 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:11.225817 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1123b57a-da8c-4d43-854e-09a953d8a428 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:11.227001 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1123b57a-da8c-4d43-854e-09a953d8a428 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:11.227787 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1123b57a-da8c-4d43-854e-09a953d8a428 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:11.805389 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-1123b57a-da8c-4d43-854e-09a953d8a428 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:11.824888 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-1123b57a-da8c-4d43-854e-09a953d8a428 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:11.830410 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-1123b57a-da8c-4d43-854e-09a953d8a428 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:11.836491 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-1123b57a-da8c-4d43-854e-09a953d8a428 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1724 microversion: 2.20 time: 0.647658 Aug 31 12:35:11.853521 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 277/543] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:11 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1724 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:12.841787 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b0f16f0b-067d-4067-ab1c-9349afc7a8e1 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Action: 'create', calling method: .version_select at 0x7f8d171ffc10>, body: {"keypair": {"name": "tempest-keypair-670290293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrs26F0xK5v57Rp7wbdHmgeL0rHznqDmFd307Vs7OnNTOGJfAVDdJW3EHeS2V/P9rOYp+A1+y3PTceI4Pk1psREmSIemhkqJLWJ1L9pa05vyH2JVUt6ToCXcVdDJqW/9g=="}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:35:12.860294 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-b0f16f0b-067d-4067-ab1c-9349afc7a8e1 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Getting quotas for project 8f6da846ab4f45a6ac4b2e34bf52abfc. Resources: {'key_pairs'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:35:12.865926 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-b0f16f0b-067d-4067-ab1c-9349afc7a8e1 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Getting quotas for user d277532df42244c693b5e51e9fd0c459 and project 8f6da846ab4f45a6ac4b2e34bf52abfc. Resources: {'key_pairs'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:35:12.880451 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-7412203d-9186-4540-94ab-25cb2d881436 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:12.881079 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-7412203d-9186-4540-94ab-25cb2d881436 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:12.888015 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7412203d-9186-4540-94ab-25cb2d881436 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:12.888514 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7412203d-9186-4540-94ab-25cb2d881436 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:12.888979 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7412203d-9186-4540-94ab-25cb2d881436 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:12.889784 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7412203d-9186-4540-94ab-25cb2d881436 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:12.890233 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7412203d-9186-4540-94ab-25cb2d881436 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:12.890680 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7412203d-9186-4540-94ab-25cb2d881436 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:12.898751 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b0f16f0b-067d-4067-ab1c-9349afc7a8e1 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.194934 Aug 31 12:35:12.899692 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 267/544] 10.222.0.79 () {60 vars in 1159 bytes} [Wed Aug 31 12:35:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:35:13.126405 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-7412203d-9186-4540-94ab-25cb2d881436 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:13.136502 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-7412203d-9186-4540-94ab-25cb2d881436 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:13.138131 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-7412203d-9186-4540-94ab-25cb2d881436 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:13.139634 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-7412203d-9186-4540-94ab-25cb2d881436 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1724 microversion: 2.20 time: 0.265824 Aug 31 12:35:13.140796 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 278/545] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:12 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:35:14.166369 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-e1263f9f-6c9f-4e99-9675-98edaeaa876e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:14.167031 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-e1263f9f-6c9f-4e99-9675-98edaeaa876e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:14.177570 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e1263f9f-6c9f-4e99-9675-98edaeaa876e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:14.178375 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e1263f9f-6c9f-4e99-9675-98edaeaa876e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:14.178833 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e1263f9f-6c9f-4e99-9675-98edaeaa876e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:14.179612 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e1263f9f-6c9f-4e99-9675-98edaeaa876e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:14.180227 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e1263f9f-6c9f-4e99-9675-98edaeaa876e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:14.180659 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e1263f9f-6c9f-4e99-9675-98edaeaa876e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:14.490431 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-e1263f9f-6c9f-4e99-9675-98edaeaa876e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:14.525732 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-e1263f9f-6c9f-4e99-9675-98edaeaa876e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:14.529053 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-e1263f9f-6c9f-4e99-9675-98edaeaa876e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:14.531360 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-e1263f9f-6c9f-4e99-9675-98edaeaa876e tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1724 microversion: 2.20 time: 0.370658 Aug 31 12:35:14.547593 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 268/546] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:14 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1724 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:35:14.575667 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-09198a10-8881-41f4-bcc1-065293e4bdae tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1262394297", "imageRef": "2aaf4ebd-395b-468e-bb6b-c663d01edea0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ccc93a47-ca46-4185-ba4c-b528eb9d4e58"}], "security_groups": [{"name": "tempest-securitygroup--1278850762"}], "key_name": "tempest-keypair-670290293", "user_data": "}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:35:14.717479 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.network.neutron [None req-09198a10-8881-41f4-bcc1-065293e4bdae tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] validate_networks() for [('ccc93a47-ca46-4185-ba4c-b528eb9d4e58', None, None, None, None, None)] {{(pid=120749) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:35:15.176109 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-09198a10-8881-41f4-bcc1-065293e4bdae tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Flavor limits 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:35:15.176547 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-09198a10-8881-41f4-bcc1-065293e4bdae tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Image limits 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:35:15.177009 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-09198a10-8881-41f4-bcc1-065293e4bdae tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Flavor pref 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:35:15.177410 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-09198a10-8881-41f4-bcc1-065293e4bdae tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Image pref 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:35:15.177808 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-09198a10-8881-41f4-bcc1-065293e4bdae tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:35:15.186792 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-09198a10-8881-41f4-bcc1-065293e4bdae tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:15.187307 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-09198a10-8881-41f4-bcc1-065293e4bdae tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:15.187730 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-09198a10-8881-41f4-bcc1-065293e4bdae tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:15.188444 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-09198a10-8881-41f4-bcc1-065293e4bdae tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:15.188894 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-09198a10-8881-41f4-bcc1-065293e4bdae tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:15.189316 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-09198a10-8881-41f4-bcc1-065293e4bdae tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:15.208736 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-09198a10-8881-41f4-bcc1-065293e4bdae tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Getting quotas for project 8f6da846ab4f45a6ac4b2e34bf52abfc. Resources: {'cores', 'ram', 'instances'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:35:15.212852 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-09198a10-8881-41f4-bcc1-065293e4bdae tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Getting quotas for user d277532df42244c693b5e51e9fd0c459 and project 8f6da846ab4f45a6ac4b2e34bf52abfc. Resources: {'cores', 'ram', 'instances'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:35:15.223812 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-09198a10-8881-41f4-bcc1-065293e4bdae tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Going to run 1 instances... {{(pid=120749) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:35:15.226098 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-09198a10-8881-41f4-bcc1-065293e4bdae tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d921f6f0-2017-4941-8d52-1abe875c6ebe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aaf4ebd-395b-468e-bb6b-c663d01edea0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:35:15.276962 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-09198a10-8881-41f4-bcc1-065293e4bdae tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.706514 Aug 31 12:35:15.277879 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 279/547] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 31 12:35:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 12:35:15.290784 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-5536b56b-06e8-42dd-84bd-873fc5465a4a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:15.290784 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-5536b56b-06e8-42dd-84bd-873fc5465a4a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d921f6f0-2017-4941-8d52-1abe875c6ebe] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:15.348788 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-5536b56b-06e8-42dd-84bd-873fc5465a4a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:15.356634 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-5536b56b-06e8-42dd-84bd-873fc5465a4a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe" status: 200 len: 1241 microversion: 2.1 time: 0.071901 Aug 31 12:35:15.357304 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 269/548] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:15 2022] GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:15.573682 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-252fea14-13a4-430d-9bd1-ad82e0a938d1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:15.574302 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-252fea14-13a4-430d-9bd1-ad82e0a938d1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:15.586021 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-252fea14-13a4-430d-9bd1-ad82e0a938d1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:15.587524 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-252fea14-13a4-430d-9bd1-ad82e0a938d1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:15.588137 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-252fea14-13a4-430d-9bd1-ad82e0a938d1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:15.589703 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-252fea14-13a4-430d-9bd1-ad82e0a938d1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:15.590595 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-252fea14-13a4-430d-9bd1-ad82e0a938d1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:15.591153 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-252fea14-13a4-430d-9bd1-ad82e0a938d1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:15.754748 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-252fea14-13a4-430d-9bd1-ad82e0a938d1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:15.764029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-252fea14-13a4-430d-9bd1-ad82e0a938d1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:15.765476 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-252fea14-13a4-430d-9bd1-ad82e0a938d1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:15.766677 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-252fea14-13a4-430d-9bd1-ad82e0a938d1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1724 microversion: 2.20 time: 0.197385 Aug 31 12:35:15.767269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 280/549] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:15 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:35:16.378089 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-40227ab2-3afd-4734-9783-169ba330a420 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:16.379614 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-40227ab2-3afd-4734-9783-169ba330a420 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d921f6f0-2017-4941-8d52-1abe875c6ebe] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:16.387810 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-40227ab2-3afd-4734-9783-169ba330a420 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:16.388394 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-40227ab2-3afd-4734-9783-169ba330a420 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:16.388903 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-40227ab2-3afd-4734-9783-169ba330a420 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:16.389705 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-40227ab2-3afd-4734-9783-169ba330a420 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:16.390225 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-40227ab2-3afd-4734-9783-169ba330a420 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:16.390897 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-40227ab2-3afd-4734-9783-169ba330a420 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:16.478390 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-40227ab2-3afd-4734-9783-169ba330a420 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:16.489153 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-40227ab2-3afd-4734-9783-169ba330a420 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe" status: 200 len: 1293 microversion: 2.1 time: 0.115130 Aug 31 12:35:16.489881 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 270/550] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:16 2022] GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe => generated 1293 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:16.792336 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-7fda74a5-11d9-43bf-803d-6780ad95b4d6 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:16.793106 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-7fda74a5-11d9-43bf-803d-6780ad95b4d6 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:16.799893 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7fda74a5-11d9-43bf-803d-6780ad95b4d6 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:16.800541 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7fda74a5-11d9-43bf-803d-6780ad95b4d6 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:16.801227 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7fda74a5-11d9-43bf-803d-6780ad95b4d6 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:16.802010 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7fda74a5-11d9-43bf-803d-6780ad95b4d6 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:16.802535 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7fda74a5-11d9-43bf-803d-6780ad95b4d6 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:16.803066 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7fda74a5-11d9-43bf-803d-6780ad95b4d6 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:16.984199 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-7fda74a5-11d9-43bf-803d-6780ad95b4d6 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:16.994070 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-7fda74a5-11d9-43bf-803d-6780ad95b4d6 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:16.995758 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-7fda74a5-11d9-43bf-803d-6780ad95b4d6 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:16.996944 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-7fda74a5-11d9-43bf-803d-6780ad95b4d6 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1724 microversion: 2.20 time: 0.208602 Aug 31 12:35:16.997508 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 281/551] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:16 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:17.512828 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-af7812c5-a788-4cd1-a595-5f494cb23a8e tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:17.513404 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-af7812c5-a788-4cd1-a595-5f494cb23a8e tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d921f6f0-2017-4941-8d52-1abe875c6ebe] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:17.519663 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-af7812c5-a788-4cd1-a595-5f494cb23a8e tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:17.520137 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-af7812c5-a788-4cd1-a595-5f494cb23a8e tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:17.520563 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-af7812c5-a788-4cd1-a595-5f494cb23a8e tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:17.521256 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-af7812c5-a788-4cd1-a595-5f494cb23a8e tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:17.521700 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-af7812c5-a788-4cd1-a595-5f494cb23a8e tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:17.522113 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-af7812c5-a788-4cd1-a595-5f494cb23a8e tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:17.684856 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-af7812c5-a788-4cd1-a595-5f494cb23a8e tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:17.696098 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-af7812c5-a788-4cd1-a595-5f494cb23a8e tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe" status: 200 len: 1367 microversion: 2.1 time: 0.187753 Aug 31 12:35:17.696860 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 271/552] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:17 2022] GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:18.021330 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-27172039-9710-4ec9-8b36-b1dd44880eaa tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:18.022025 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-27172039-9710-4ec9-8b36-b1dd44880eaa tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:18.031949 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-27172039-9710-4ec9-8b36-b1dd44880eaa tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:18.032350 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-27172039-9710-4ec9-8b36-b1dd44880eaa tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:18.032788 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-27172039-9710-4ec9-8b36-b1dd44880eaa tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:18.033487 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-27172039-9710-4ec9-8b36-b1dd44880eaa tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:18.033935 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-27172039-9710-4ec9-8b36-b1dd44880eaa tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:18.035015 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-27172039-9710-4ec9-8b36-b1dd44880eaa tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:18.180087 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-a973af85-ade0-47e0-9ee9-a3263e7f6c2d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:18.180757 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-a973af85-ade0-47e0-9ee9-a3263e7f6c2d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:18.186931 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a973af85-ade0-47e0-9ee9-a3263e7f6c2d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:18.187436 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a973af85-ade0-47e0-9ee9-a3263e7f6c2d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:18.187891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a973af85-ade0-47e0-9ee9-a3263e7f6c2d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:18.188599 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a973af85-ade0-47e0-9ee9-a3263e7f6c2d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:18.189052 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a973af85-ade0-47e0-9ee9-a3263e7f6c2d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:18.189481 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a973af85-ade0-47e0-9ee9-a3263e7f6c2d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:18.215699 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-a973af85-ade0-47e0-9ee9-a3263e7f6c2d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f/ips" status: 200 len: 147 microversion: 2.1 time: 0.159959 Aug 31 12:35:18.216301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 272/553] 10.222.0.79 () {58 vars in 1248 bytes} [Wed Aug 31 12:35:18 2022] GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f/ips => generated 147 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:35:18.289525 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-27172039-9710-4ec9-8b36-b1dd44880eaa tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:18.299446 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-27172039-9710-4ec9-8b36-b1dd44880eaa tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:18.301307 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-27172039-9710-4ec9-8b36-b1dd44880eaa tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:18.302783 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-27172039-9710-4ec9-8b36-b1dd44880eaa tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1745 microversion: 2.20 time: 0.285488 Aug 31 12:35:18.303766 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 282/554] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:18 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1745 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:35:18.422780 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-660bd980-2da7-44e7-9ec6-66dab69e5caf req-cef53586-e828-4352-9450-53b34404b836 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d921f6f0-2017-4941-8d52-1abe875c6ebe", "tag": "5e09f684-a590-4082-ad90-cdda42260677"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:35:18.445093 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-660bd980-2da7-44e7-9ec6-66dab69e5caf req-cef53586-e828-4352-9450-53b34404b836 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:18.445567 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-660bd980-2da7-44e7-9ec6-66dab69e5caf req-cef53586-e828-4352-9450-53b34404b836 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:18.446192 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-660bd980-2da7-44e7-9ec6-66dab69e5caf req-cef53586-e828-4352-9450-53b34404b836 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:18.476903 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-660bd980-2da7-44e7-9ec6-66dab69e5caf req-cef53586-e828-4352-9450-53b34404b836 service nova] Creating event network-changed:5e09f684-a590-4082-ad90-cdda42260677 for instance d921f6f0-2017-4941-8d52-1abe875c6ebe on hv-cinder-85528 Aug 31 12:35:18.495116 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-660bd980-2da7-44e7-9ec6-66dab69e5caf req-cef53586-e828-4352-9450-53b34404b836 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077461 Aug 31 12:35:18.496944 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 273/555] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:35:18.730617 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-d0204400-72d8-470e-8944-628958449a3a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:18.731263 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-d0204400-72d8-470e-8944-628958449a3a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d921f6f0-2017-4941-8d52-1abe875c6ebe] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:18.738932 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d0204400-72d8-470e-8944-628958449a3a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:18.739866 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d0204400-72d8-470e-8944-628958449a3a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:18.740300 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d0204400-72d8-470e-8944-628958449a3a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:18.741009 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d0204400-72d8-470e-8944-628958449a3a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:18.741463 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d0204400-72d8-470e-8944-628958449a3a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:18.742009 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d0204400-72d8-470e-8944-628958449a3a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:18.991143 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-d0204400-72d8-470e-8944-628958449a3a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:19.000241 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-d0204400-72d8-470e-8944-628958449a3a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe" status: 200 len: 1367 microversion: 2.1 time: 0.273192 Aug 31 12:35:19.005464 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 283/556] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:18 2022] GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:19.347365 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-f085f2b5-d66c-49c7-b67a-f6ecacc9de9d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:19.348125 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-f085f2b5-d66c-49c7-b67a-f6ecacc9de9d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:19.356006 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f085f2b5-d66c-49c7-b67a-f6ecacc9de9d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:19.356616 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f085f2b5-d66c-49c7-b67a-f6ecacc9de9d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:19.357473 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f085f2b5-d66c-49c7-b67a-f6ecacc9de9d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:19.357895 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f085f2b5-d66c-49c7-b67a-f6ecacc9de9d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:19.358343 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f085f2b5-d66c-49c7-b67a-f6ecacc9de9d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:19.358757 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f085f2b5-d66c-49c7-b67a-f6ecacc9de9d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:19.495556 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f085f2b5-d66c-49c7-b67a-f6ecacc9de9d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:19.504440 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f085f2b5-d66c-49c7-b67a-f6ecacc9de9d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:19.505879 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f085f2b5-d66c-49c7-b67a-f6ecacc9de9d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:19.507159 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-f085f2b5-d66c-49c7-b67a-f6ecacc9de9d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1745 microversion: 2.20 time: 0.164847 Aug 31 12:35:19.507712 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 274/557] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:19 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:19.680473 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-c74d487a-0738-4dfd-be0c-3ae082e2c812 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97ad22dd-b4c4-43c2-9bec-bd4b1829a8fb"}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:35:19.683140 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-c74d487a-0738-4dfd-be0c-3ae082e2c812 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:19.689270 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c74d487a-0738-4dfd-be0c-3ae082e2c812 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:19.689766 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c74d487a-0738-4dfd-be0c-3ae082e2c812 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:19.690189 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c74d487a-0738-4dfd-be0c-3ae082e2c812 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:19.691509 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c74d487a-0738-4dfd-be0c-3ae082e2c812 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:19.691992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c74d487a-0738-4dfd-be0c-3ae082e2c812 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:19.692408 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c74d487a-0738-4dfd-be0c-3ae082e2c812 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:20.024479 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b7cb4a56-c4a0-4094-99b0-f3a05e0c4172 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:20.025248 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-b7cb4a56-c4a0-4094-99b0-f3a05e0c4172 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d921f6f0-2017-4941-8d52-1abe875c6ebe] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:20.045352 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b7cb4a56-c4a0-4094-99b0-f3a05e0c4172 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:20.046173 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b7cb4a56-c4a0-4094-99b0-f3a05e0c4172 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:20.046755 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b7cb4a56-c4a0-4094-99b0-f3a05e0c4172 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:20.047668 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b7cb4a56-c4a0-4094-99b0-f3a05e0c4172 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:20.048407 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b7cb4a56-c4a0-4094-99b0-f3a05e0c4172 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:20.048939 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b7cb4a56-c4a0-4094-99b0-f3a05e0c4172 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:20.140883 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-c74d487a-0738-4dfd-be0c-3ae082e2c812 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "POST /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.462693 Aug 31 12:35:20.141875 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 284/558] 10.222.0.79 () {60 vars in 1323 bytes} [Wed Aug 31 12:35:19 2022] POST /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f/os-volume_attachments => generated 194 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:35:20.223095 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b7cb4a56-c4a0-4094-99b0-f3a05e0c4172 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:20.233034 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b7cb4a56-c4a0-4094-99b0-f3a05e0c4172 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe" status: 200 len: 1367 microversion: 2.1 time: 0.214300 Aug 31 12:35:20.242965 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 275/559] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:20 2022] GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:20.535689 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-81336268-ceb7-43ad-9358-c61c234c2f39 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:20.536820 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-81336268-ceb7-43ad-9358-c61c234c2f39 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:20.544610 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-81336268-ceb7-43ad-9358-c61c234c2f39 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:20.545109 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-81336268-ceb7-43ad-9358-c61c234c2f39 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:20.545750 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-81336268-ceb7-43ad-9358-c61c234c2f39 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:20.546654 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-81336268-ceb7-43ad-9358-c61c234c2f39 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:20.547150 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-81336268-ceb7-43ad-9358-c61c234c2f39 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:20.547578 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-81336268-ceb7-43ad-9358-c61c234c2f39 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:20.710356 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-81336268-ceb7-43ad-9358-c61c234c2f39 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:20.717160 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-81336268-ceb7-43ad-9358-c61c234c2f39 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:20.718672 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-81336268-ceb7-43ad-9358-c61c234c2f39 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:20.719815 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-81336268-ceb7-43ad-9358-c61c234c2f39 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1740 microversion: 2.20 time: 0.191691 Aug 31 12:35:20.720371 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 285/560] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:20 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:21.262469 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-05c62181-c145-4f80-a793-7364cedfafe3 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:21.264698 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-05c62181-c145-4f80-a793-7364cedfafe3 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d921f6f0-2017-4941-8d52-1abe875c6ebe] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:21.278526 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-05c62181-c145-4f80-a793-7364cedfafe3 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:21.279412 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-05c62181-c145-4f80-a793-7364cedfafe3 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:21.280257 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-05c62181-c145-4f80-a793-7364cedfafe3 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:21.281159 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-05c62181-c145-4f80-a793-7364cedfafe3 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:21.281776 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-05c62181-c145-4f80-a793-7364cedfafe3 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:21.282355 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-05c62181-c145-4f80-a793-7364cedfafe3 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:21.510011 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-05c62181-c145-4f80-a793-7364cedfafe3 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:21.521154 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-05c62181-c145-4f80-a793-7364cedfafe3 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe" status: 200 len: 1367 microversion: 2.1 time: 0.263618 Aug 31 12:35:21.526927 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 276/561] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:21 2022] GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:21.564166 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-849ac80b-ad65-4ffb-80e8-95fdc58263e4 req-89fb561a-c3a8-43ea-8b9a-42e5d2bd9c7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bee1640-e8d5-48a7-b437-414aac42397a", "name": "network-vif-plugged", "status": "completed", "tag": "b673aa1b-a57f-46f1-bb92-bd62f55d451c"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:35:21.578916 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-849ac80b-ad65-4ffb-80e8-95fdc58263e4 req-89fb561a-c3a8-43ea-8b9a-42e5d2bd9c7d service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:21.580317 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-849ac80b-ad65-4ffb-80e8-95fdc58263e4 req-89fb561a-c3a8-43ea-8b9a-42e5d2bd9c7d service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:21.581146 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-849ac80b-ad65-4ffb-80e8-95fdc58263e4 req-89fb561a-c3a8-43ea-8b9a-42e5d2bd9c7d service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:21.600183 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-849ac80b-ad65-4ffb-80e8-95fdc58263e4 req-89fb561a-c3a8-43ea-8b9a-42e5d2bd9c7d service nova] Creating event network-vif-plugged:b673aa1b-a57f-46f1-bb92-bd62f55d451c for instance 8bee1640-e8d5-48a7-b437-414aac42397a on hv-cinder-85528 Aug 31 12:35:21.608173 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-849ac80b-ad65-4ffb-80e8-95fdc58263e4 req-89fb561a-c3a8-43ea-8b9a-42e5d2bd9c7d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047879 Aug 31 12:35:21.609821 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 286/562] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:35:21.748442 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-0d5df759-8de2-49c1-a018-245816caf372 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:21.759326 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-0d5df759-8de2-49c1-a018-245816caf372 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:21.773115 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0d5df759-8de2-49c1-a018-245816caf372 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:21.773940 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0d5df759-8de2-49c1-a018-245816caf372 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:21.774561 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0d5df759-8de2-49c1-a018-245816caf372 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:21.775496 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0d5df759-8de2-49c1-a018-245816caf372 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:21.776154 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0d5df759-8de2-49c1-a018-245816caf372 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:21.776638 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0d5df759-8de2-49c1-a018-245816caf372 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:21.946265 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-0d5df759-8de2-49c1-a018-245816caf372 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:21.956576 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-0d5df759-8de2-49c1-a018-245816caf372 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:21.958632 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-0d5df759-8de2-49c1-a018-245816caf372 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:21.963006 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-0d5df759-8de2-49c1-a018-245816caf372 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1740 microversion: 2.20 time: 0.222280 Aug 31 12:35:21.979302 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 277/563] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:21 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1740 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:22.529854 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-7e403f01-cca1-4893-8d8b-51078289bbea tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:22.531109 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-7e403f01-cca1-4893-8d8b-51078289bbea tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:22.543086 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-83f161c0-f4d2-4485-a22a-5c47ebfb3d8d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:22.544340 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-83f161c0-f4d2-4485-a22a-5c47ebfb3d8d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d921f6f0-2017-4941-8d52-1abe875c6ebe] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:22.552590 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-83f161c0-f4d2-4485-a22a-5c47ebfb3d8d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:22.553080 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-83f161c0-f4d2-4485-a22a-5c47ebfb3d8d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:22.553514 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-83f161c0-f4d2-4485-a22a-5c47ebfb3d8d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:22.554216 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-83f161c0-f4d2-4485-a22a-5c47ebfb3d8d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:22.554672 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-83f161c0-f4d2-4485-a22a-5c47ebfb3d8d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:22.555126 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-83f161c0-f4d2-4485-a22a-5c47ebfb3d8d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:22.557168 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7e403f01-cca1-4893-8d8b-51078289bbea tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:22.557654 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7e403f01-cca1-4893-8d8b-51078289bbea tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:22.558250 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7e403f01-cca1-4893-8d8b-51078289bbea tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:22.559177 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7e403f01-cca1-4893-8d8b-51078289bbea tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:22.559812 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7e403f01-cca1-4893-8d8b-51078289bbea tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:22.560430 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7e403f01-cca1-4893-8d8b-51078289bbea tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:22.563595 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:22.568780 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:22.619182 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-7e403f01-cca1-4893-8d8b-51078289bbea tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Going to try to terminate instance {{(pid=120749) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:35:22.742450 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-7e403f01-cca1-4893-8d8b-51078289bbea tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "DELETE /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 204 len: 0 microversion: 2.1 time: 0.216388 Aug 31 12:35:22.743090 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 287/564] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 31 12:35:22 2022] DELETE /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:35:22.749144 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-83f161c0-f4d2-4485-a22a-5c47ebfb3d8d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:22.753812 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-7ebf40b6-5c07-4663-b123-e53890d61117 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:22.754557 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-7ebf40b6-5c07-4663-b123-e53890d61117 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:22.759981 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-83f161c0-f4d2-4485-a22a-5c47ebfb3d8d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe" status: 200 len: 1367 microversion: 2.1 time: 0.221270 Aug 31 12:35:22.761724 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7ebf40b6-5c07-4663-b123-e53890d61117 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:22.762279 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7ebf40b6-5c07-4663-b123-e53890d61117 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:22.762728 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7ebf40b6-5c07-4663-b123-e53890d61117 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:22.763554 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7ebf40b6-5c07-4663-b123-e53890d61117 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:22.764029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7ebf40b6-5c07-4663-b123-e53890d61117 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:22.764509 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7ebf40b6-5c07-4663-b123-e53890d61117 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:22.771371 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 278/565] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:22 2022] GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:22.922466 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-7ebf40b6-5c07-4663-b123-e53890d61117 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:22.931854 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-7ebf40b6-5c07-4663-b123-e53890d61117 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 200 len: 1577 microversion: 2.1 time: 0.184043 Aug 31 12:35:22.932989 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 288/566] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:22 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 1577 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:22.985627 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-4fa21f40-fc9d-4e82-9499-a51798a6d9ff tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:22.986542 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-4fa21f40-fc9d-4e82-9499-a51798a6d9ff tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:22.993769 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4fa21f40-fc9d-4e82-9499-a51798a6d9ff tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:22.994266 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4fa21f40-fc9d-4e82-9499-a51798a6d9ff tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:22.994697 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4fa21f40-fc9d-4e82-9499-a51798a6d9ff tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:22.995954 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4fa21f40-fc9d-4e82-9499-a51798a6d9ff tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:22.996582 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4fa21f40-fc9d-4e82-9499-a51798a6d9ff tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:22.997005 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4fa21f40-fc9d-4e82-9499-a51798a6d9ff tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:23.154162 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-4fa21f40-fc9d-4e82-9499-a51798a6d9ff tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:23.164966 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-4fa21f40-fc9d-4e82-9499-a51798a6d9ff tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:23.166409 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-4fa21f40-fc9d-4e82-9499-a51798a6d9ff tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:23.167607 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-4fa21f40-fc9d-4e82-9499-a51798a6d9ff tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1740 microversion: 2.20 time: 0.185895 Aug 31 12:35:23.168773 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 279/567] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:22 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:23.632909 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-0bcc7d8b-7846-4a3c-b171-8ac1caba4f8d req-15900aa8-8399-41e5-b470-e27886379095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d921f6f0-2017-4941-8d52-1abe875c6ebe", "name": "network-vif-plugged", "status": "completed", "tag": "5e09f684-a590-4082-ad90-cdda42260677"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:35:23.642552 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-0bcc7d8b-7846-4a3c-b171-8ac1caba4f8d req-15900aa8-8399-41e5-b470-e27886379095 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:23.643292 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-0bcc7d8b-7846-4a3c-b171-8ac1caba4f8d req-15900aa8-8399-41e5-b470-e27886379095 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:23.644316 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-0bcc7d8b-7846-4a3c-b171-8ac1caba4f8d req-15900aa8-8399-41e5-b470-e27886379095 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:23.657369 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-0bcc7d8b-7846-4a3c-b171-8ac1caba4f8d req-15900aa8-8399-41e5-b470-e27886379095 service nova] Creating event network-vif-plugged:5e09f684-a590-4082-ad90-cdda42260677 for instance d921f6f0-2017-4941-8d52-1abe875c6ebe on hv-cinder-85528 Aug 31 12:35:23.663296 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-0bcc7d8b-7846-4a3c-b171-8ac1caba4f8d req-15900aa8-8399-41e5-b470-e27886379095 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033559 Aug 31 12:35:23.666115 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 289/568] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:35:23.785573 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-fb5548aa-8155-43e3-8f61-f0b4ff606fce tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:23.786173 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-fb5548aa-8155-43e3-8f61-f0b4ff606fce tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d921f6f0-2017-4941-8d52-1abe875c6ebe] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:23.792704 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fb5548aa-8155-43e3-8f61-f0b4ff606fce tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:23.793402 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fb5548aa-8155-43e3-8f61-f0b4ff606fce tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:23.794003 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fb5548aa-8155-43e3-8f61-f0b4ff606fce tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:23.794894 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fb5548aa-8155-43e3-8f61-f0b4ff606fce tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:23.795506 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fb5548aa-8155-43e3-8f61-f0b4ff606fce tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:23.796085 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fb5548aa-8155-43e3-8f61-f0b4ff606fce tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:23.955447 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-33017545-2f09-4c9a-a1dd-de33e9063270 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:23.956330 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-33017545-2f09-4c9a-a1dd-de33e9063270 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:23.968211 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-33017545-2f09-4c9a-a1dd-de33e9063270 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:23.970279 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-33017545-2f09-4c9a-a1dd-de33e9063270 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:23.970769 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-33017545-2f09-4c9a-a1dd-de33e9063270 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:23.973698 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-33017545-2f09-4c9a-a1dd-de33e9063270 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:23.975227 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-33017545-2f09-4c9a-a1dd-de33e9063270 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:23.976815 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-33017545-2f09-4c9a-a1dd-de33e9063270 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:23.985998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-fb5548aa-8155-43e3-8f61-f0b4ff606fce tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:24.000134 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-fb5548aa-8155-43e3-8f61-f0b4ff606fce tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe" status: 200 len: 1367 microversion: 2.1 time: 0.219056 Aug 31 12:35:24.014538 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 280/569] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:23 2022] GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:24.187230 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-33017545-2f09-4c9a-a1dd-de33e9063270 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:24.194175 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-43c2f269-ac09-4bdd-b58b-66df681ff79b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:24.194924 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-43c2f269-ac09-4bdd-b58b-66df681ff79b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:24.210255 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-43c2f269-ac09-4bdd-b58b-66df681ff79b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:24.211018 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-43c2f269-ac09-4bdd-b58b-66df681ff79b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:24.211171 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-33017545-2f09-4c9a-a1dd-de33e9063270 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 200 len: 1577 microversion: 2.1 time: 0.260105 Aug 31 12:35:24.211750 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-43c2f269-ac09-4bdd-b58b-66df681ff79b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:24.212073 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 290/570] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:23 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 1577 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:24.212748 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-43c2f269-ac09-4bdd-b58b-66df681ff79b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:24.213368 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-43c2f269-ac09-4bdd-b58b-66df681ff79b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:24.214170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-43c2f269-ac09-4bdd-b58b-66df681ff79b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:24.401236 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-43c2f269-ac09-4bdd-b58b-66df681ff79b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:24.412273 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-43c2f269-ac09-4bdd-b58b-66df681ff79b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:24.413707 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-43c2f269-ac09-4bdd-b58b-66df681ff79b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:24.415080 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-43c2f269-ac09-4bdd-b58b-66df681ff79b tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1740 microversion: 2.20 time: 0.225237 Aug 31 12:35:24.415644 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 281/571] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:24 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1740 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:25.023347 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-d71e84ec-6071-4bcc-8d79-e6d64928d39d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:25.024604 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-d71e84ec-6071-4bcc-8d79-e6d64928d39d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d921f6f0-2017-4941-8d52-1abe875c6ebe] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:25.044604 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d71e84ec-6071-4bcc-8d79-e6d64928d39d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:25.045375 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d71e84ec-6071-4bcc-8d79-e6d64928d39d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:25.051481 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d71e84ec-6071-4bcc-8d79-e6d64928d39d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:25.052680 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d71e84ec-6071-4bcc-8d79-e6d64928d39d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:25.053318 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d71e84ec-6071-4bcc-8d79-e6d64928d39d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:25.054042 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d71e84ec-6071-4bcc-8d79-e6d64928d39d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:25.198493 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=2 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:25.219965 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=6 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:25.234195 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b3b970fc-26a0-43d0-9050-c47489159508 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:25.239573 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-b3b970fc-26a0-43d0-9050-c47489159508 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:25.251762 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b3b970fc-26a0-43d0-9050-c47489159508 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:25.252759 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b3b970fc-26a0-43d0-9050-c47489159508 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:25.256004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b3b970fc-26a0-43d0-9050-c47489159508 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:25.256948 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b3b970fc-26a0-43d0-9050-c47489159508 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:25.257608 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b3b970fc-26a0-43d0-9050-c47489159508 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:25.258353 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b3b970fc-26a0-43d0-9050-c47489159508 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:25.261823 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-d71e84ec-6071-4bcc-8d79-e6d64928d39d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:25.282196 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-d71e84ec-6071-4bcc-8d79-e6d64928d39d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe" status: 200 len: 1367 microversion: 2.1 time: 0.258563 Aug 31 12:35:25.284010 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 291/572] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:25 2022] GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:25.356321 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell0:SELECT=6 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:25.381937 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b3b970fc-26a0-43d0-9050-c47489159508 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:25.396593 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b3b970fc-26a0-43d0-9050-c47489159508 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 200 len: 1509 microversion: 2.1 time: 0.167229 Aug 31 12:35:25.410798 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 282/573] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:25 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:25.441645 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-ed745a3c-2f2f-4900-8919-dd6a997c2a1a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:25.442245 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-ed745a3c-2f2f-4900-8919-dd6a997c2a1a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:25.458995 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ed745a3c-2f2f-4900-8919-dd6a997c2a1a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:25.459488 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ed745a3c-2f2f-4900-8919-dd6a997c2a1a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:25.459959 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ed745a3c-2f2f-4900-8919-dd6a997c2a1a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:25.460657 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ed745a3c-2f2f-4900-8919-dd6a997c2a1a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:25.461111 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ed745a3c-2f2f-4900-8919-dd6a997c2a1a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:25.461525 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ed745a3c-2f2f-4900-8919-dd6a997c2a1a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:25.626540 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-ed745a3c-2f2f-4900-8919-dd6a997c2a1a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:25.636846 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-ed745a3c-2f2f-4900-8919-dd6a997c2a1a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:25.638259 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-ed745a3c-2f2f-4900-8919-dd6a997c2a1a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:25.640104 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-ed745a3c-2f2f-4900-8919-dd6a997c2a1a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1740 microversion: 2.20 time: 0.202969 Aug 31 12:35:25.641192 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 292/574] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:25 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:25.879701 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-4ec1549b-2fa4-4970-8898-ac30c5c9795a req-c431fbdc-1626-450d-a1be-e1a9c1ad2649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688b1262-46e9-4330-b633-05fc6a28cee3", "name": "network-vif-deleted", "tag": "67e6c039-8531-4434-9617-4b63cd64bdce"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:35:25.891619 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-4ec1549b-2fa4-4970-8898-ac30c5c9795a req-c431fbdc-1626-450d-a1be-e1a9c1ad2649 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:25.892499 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-4ec1549b-2fa4-4970-8898-ac30c5c9795a req-c431fbdc-1626-450d-a1be-e1a9c1ad2649 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:25.893168 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-4ec1549b-2fa4-4970-8898-ac30c5c9795a req-c431fbdc-1626-450d-a1be-e1a9c1ad2649 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:25.920801 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-4ec1549b-2fa4-4970-8898-ac30c5c9795a req-c431fbdc-1626-450d-a1be-e1a9c1ad2649 service nova] Creating event network-vif-deleted:67e6c039-8531-4434-9617-4b63cd64bdce for instance 688b1262-46e9-4330-b633-05fc6a28cee3 on hv-cinder-85528 Aug 31 12:35:25.942698 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-4ec1549b-2fa4-4970-8898-ac30c5c9795a req-c431fbdc-1626-450d-a1be-e1a9c1ad2649 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203040 Aug 31 12:35:25.946500 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 283/575] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:35:26.304637 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-cfc64afa-b798-4d9a-b1f3-8a9175caaaea tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:26.305872 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-cfc64afa-b798-4d9a-b1f3-8a9175caaaea tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d921f6f0-2017-4941-8d52-1abe875c6ebe] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:26.321454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cfc64afa-b798-4d9a-b1f3-8a9175caaaea tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:26.321961 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cfc64afa-b798-4d9a-b1f3-8a9175caaaea tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:26.322448 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cfc64afa-b798-4d9a-b1f3-8a9175caaaea tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:26.323161 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cfc64afa-b798-4d9a-b1f3-8a9175caaaea tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:26.323794 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cfc64afa-b798-4d9a-b1f3-8a9175caaaea tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:26.324451 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cfc64afa-b798-4d9a-b1f3-8a9175caaaea tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:26.418691 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-cbd380d3-7209-41ab-9202-e928b93fc768 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:26.420179 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-cbd380d3-7209-41ab-9202-e928b93fc768 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:26.434674 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cbd380d3-7209-41ab-9202-e928b93fc768 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:26.435206 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cbd380d3-7209-41ab-9202-e928b93fc768 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:26.435713 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cbd380d3-7209-41ab-9202-e928b93fc768 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:26.437682 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cbd380d3-7209-41ab-9202-e928b93fc768 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:26.438222 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cbd380d3-7209-41ab-9202-e928b93fc768 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:26.439679 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cbd380d3-7209-41ab-9202-e928b93fc768 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:26.536758 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-cbd380d3-7209-41ab-9202-e928b93fc768 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:26.550907 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-cfc64afa-b798-4d9a-b1f3-8a9175caaaea tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:26.553519 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-cbd380d3-7209-41ab-9202-e928b93fc768 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 200 len: 1225 microversion: 2.1 time: 0.139122 Aug 31 12:35:26.555308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 284/576] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:26 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 1225 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:26.564803 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-cfc64afa-b798-4d9a-b1f3-8a9175caaaea tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe" status: 200 len: 1557 microversion: 2.1 time: 0.263860 Aug 31 12:35:26.566186 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 293/577] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:26 2022] GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe => generated 1557 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:26.588081 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-f4a2de72-2104-46a3-a945-b994b8c9abfd tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:26.588899 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-f4a2de72-2104-46a3-a945-b994b8c9abfd tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d921f6f0-2017-4941-8d52-1abe875c6ebe] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:26.596076 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f4a2de72-2104-46a3-a945-b994b8c9abfd tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:26.596906 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f4a2de72-2104-46a3-a945-b994b8c9abfd tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:26.597670 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f4a2de72-2104-46a3-a945-b994b8c9abfd tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:26.598655 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f4a2de72-2104-46a3-a945-b994b8c9abfd tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:26.599336 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f4a2de72-2104-46a3-a945-b994b8c9abfd tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:26.599994 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f4a2de72-2104-46a3-a945-b994b8c9abfd tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:26.699406 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-88d7e8db-fa5f-49fd-a5d7-9b7fc13e89d0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:26.700409 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-88d7e8db-fa5f-49fd-a5d7-9b7fc13e89d0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:26.712103 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-88d7e8db-fa5f-49fd-a5d7-9b7fc13e89d0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:26.712946 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-88d7e8db-fa5f-49fd-a5d7-9b7fc13e89d0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:26.713595 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-88d7e8db-fa5f-49fd-a5d7-9b7fc13e89d0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:26.714606 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-88d7e8db-fa5f-49fd-a5d7-9b7fc13e89d0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:26.715299 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-88d7e8db-fa5f-49fd-a5d7-9b7fc13e89d0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:26.719403 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-88d7e8db-fa5f-49fd-a5d7-9b7fc13e89d0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:26.759265 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-f4a2de72-2104-46a3-a945-b994b8c9abfd tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.174893 Aug 31 12:35:26.759864 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 285/578] 10.222.0.79 () {58 vars in 1275 bytes} [Wed Aug 31 12:35:26 2022] GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:35:27.058303 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-88d7e8db-fa5f-49fd-a5d7-9b7fc13e89d0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:27.074111 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-88d7e8db-fa5f-49fd-a5d7-9b7fc13e89d0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:27.075918 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-88d7e8db-fa5f-49fd-a5d7-9b7fc13e89d0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:27.077357 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-88d7e8db-fa5f-49fd-a5d7-9b7fc13e89d0 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1740 microversion: 2.20 time: 0.383165 Aug 31 12:35:27.078413 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 294/579] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:26 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1740 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:35:27.577740 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-4c1c83aa-6aa3-4ca7-8176-0ecaecca7725 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:27.578349 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-4c1c83aa-6aa3-4ca7-8176-0ecaecca7725 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:27.594594 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4c1c83aa-6aa3-4ca7-8176-0ecaecca7725 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:27.596846 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4c1c83aa-6aa3-4ca7-8176-0ecaecca7725 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:27.597607 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4c1c83aa-6aa3-4ca7-8176-0ecaecca7725 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:27.601092 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4c1c83aa-6aa3-4ca7-8176-0ecaecca7725 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:27.601800 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4c1c83aa-6aa3-4ca7-8176-0ecaecca7725 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:27.602763 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4c1c83aa-6aa3-4ca7-8176-0ecaecca7725 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:27.676576 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4c1c83aa-6aa3-4ca7-8176-0ecaecca7725 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:27.677449 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4c1c83aa-6aa3-4ca7-8176-0ecaecca7725 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:27.678092 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4c1c83aa-6aa3-4ca7-8176-0ecaecca7725 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:27.678727 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.objects.instance [None req-4c1c83aa-6aa3-4ca7-8176-0ecaecca7725 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lazy-loading 'fault' on Instance uuid 688b1262-46e9-4330-b633-05fc6a28cee3 {{(pid=120750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:35:27.739848 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-4c1c83aa-6aa3-4ca7-8176-0ecaecca7725 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:27.757055 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-4c1c83aa-6aa3-4ca7-8176-0ecaecca7725 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 200 len: 1184 microversion: 2.1 time: 0.184094 Aug 31 12:35:27.758174 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 286/580] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:27 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 1184 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:28.106044 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-e2490b37-d2f3-4c9e-8141-b72a5b1dbc59 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:28.106879 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-e2490b37-d2f3-4c9e-8141-b72a5b1dbc59 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:28.126650 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2490b37-d2f3-4c9e-8141-b72a5b1dbc59 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:28.127224 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2490b37-d2f3-4c9e-8141-b72a5b1dbc59 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:28.127622 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2490b37-d2f3-4c9e-8141-b72a5b1dbc59 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:28.128547 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2490b37-d2f3-4c9e-8141-b72a5b1dbc59 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:28.129240 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2490b37-d2f3-4c9e-8141-b72a5b1dbc59 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:28.129688 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2490b37-d2f3-4c9e-8141-b72a5b1dbc59 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:28.380316 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-08ed6da5-061b-4e34-b89f-f42907e656b5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:28.384110 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-08ed6da5-061b-4e34-b89f-f42907e656b5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:28.394387 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-08ed6da5-061b-4e34-b89f-f42907e656b5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:28.395553 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-08ed6da5-061b-4e34-b89f-f42907e656b5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:28.396685 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-08ed6da5-061b-4e34-b89f-f42907e656b5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:28.398151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-08ed6da5-061b-4e34-b89f-f42907e656b5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:28.399443 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-08ed6da5-061b-4e34-b89f-f42907e656b5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:28.400619 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-08ed6da5-061b-4e34-b89f-f42907e656b5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:28.433117 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-e2490b37-d2f3-4c9e-8141-b72a5b1dbc59 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:28.458742 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-e2490b37-d2f3-4c9e-8141-b72a5b1dbc59 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:28.464661 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-08ed6da5-061b-4e34-b89f-f42907e656b5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092291 Aug 31 12:35:28.466914 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 287/581] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 31 12:35:28 2022] GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:35:28.467132 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-e2490b37-d2f3-4c9e-8141-b72a5b1dbc59 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:28.469628 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-e2490b37-d2f3-4c9e-8141-b72a5b1dbc59 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1740 microversion: 2.20 time: 0.367458 Aug 31 12:35:28.473226 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 295/582] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:28 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1740 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:35:28.502362 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-3e89adcb-4100-433c-bdb5-a077f05c7bdf tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:28.503423 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-3e89adcb-4100-433c-bdb5-a077f05c7bdf tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:28.516181 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3e89adcb-4100-433c-bdb5-a077f05c7bdf tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:28.516969 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3e89adcb-4100-433c-bdb5-a077f05c7bdf tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:28.518375 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3e89adcb-4100-433c-bdb5-a077f05c7bdf tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:28.520259 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3e89adcb-4100-433c-bdb5-a077f05c7bdf tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:28.521278 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3e89adcb-4100-433c-bdb5-a077f05c7bdf tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:28.522019 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3e89adcb-4100-433c-bdb5-a077f05c7bdf tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:28.610156 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-54228836-f6b5-4e5b-bdff-3dd649dfbb95 req-299e4221-066c-4476-a9eb-06b9adb00f92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d921f6f0-2017-4941-8d52-1abe875c6ebe", "tag": "5e09f684-a590-4082-ad90-cdda42260677"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:35:28.617848 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-3e89adcb-4100-433c-bdb5-a077f05c7bdf tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f/os-volume_attachments/97ad22dd-b4c4-43c2-9bec-bd4b1829a8fb" status: 200 len: 194 microversion: 2.1 time: 0.136817 Aug 31 12:35:28.618812 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 288/583] 10.222.0.79 () {58 vars in 1413 bytes} [Wed Aug 31 12:35:28 2022] GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f/os-volume_attachments/97ad22dd-b4c4-43c2-9bec-bd4b1829a8fb => generated 194 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:35:28.634013 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-54228836-f6b5-4e5b-bdff-3dd649dfbb95 req-299e4221-066c-4476-a9eb-06b9adb00f92 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:28.640264 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-54228836-f6b5-4e5b-bdff-3dd649dfbb95 req-299e4221-066c-4476-a9eb-06b9adb00f92 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:28.640956 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-54228836-f6b5-4e5b-bdff-3dd649dfbb95 req-299e4221-066c-4476-a9eb-06b9adb00f92 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:28.662445 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-54228836-f6b5-4e5b-bdff-3dd649dfbb95 req-299e4221-066c-4476-a9eb-06b9adb00f92 service nova] Creating event network-changed:5e09f684-a590-4082-ad90-cdda42260677 for instance d921f6f0-2017-4941-8d52-1abe875c6ebe on hv-cinder-85528 Aug 31 12:35:28.670810 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-54228836-f6b5-4e5b-bdff-3dd649dfbb95 req-299e4221-066c-4476-a9eb-06b9adb00f92 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063917 Aug 31 12:35:28.676068 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 296/584] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:35:28.781512 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-8af6df43-43dc-4721-94e7-a1cb18fdf869 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:28.782248 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-8af6df43-43dc-4721-94e7-a1cb18fdf869 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:28.785074 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=1 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:28.795367 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8af6df43-43dc-4721-94e7-a1cb18fdf869 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:28.798622 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8af6df43-43dc-4721-94e7-a1cb18fdf869 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:28.800442 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8af6df43-43dc-4721-94e7-a1cb18fdf869 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:28.802109 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8af6df43-43dc-4721-94e7-a1cb18fdf869 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:28.803981 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8af6df43-43dc-4721-94e7-a1cb18fdf869 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:28.804546 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8af6df43-43dc-4721-94e7-a1cb18fdf869 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:28.850766 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-8af6df43-43dc-4721-94e7-a1cb18fdf869 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] HTTP exception thrown: Instance 688b1262-46e9-4330-b633-05fc6a28cee3 could not be found. Aug 31 12:35:28.855738 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-8af6df43-43dc-4721-94e7-a1cb18fdf869 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Request method failure captured: Aug 31 12:35:28.855738 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 HTTP/1.1 Aug 31 12:35:28.855738 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:35:28.855738 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:35:28.855738 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:35:28.855738 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 0 Aug 31 12:35:28.855738 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:35:28.855738 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:35:28.855738 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:35:28.855738 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:35:28.855738 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1TKnJSWeeKQm_1NqqsKqOsHHQXTPzhADDpYcTDRl9mIGATR_iTWyrefkZEIfHAgLtHW8qiHxUYObBzU5-t-1KWBmcNldBVTKMnmykcZ9Bp-C7BOODdG3CAY4lH4U2IWDZSZYpgijrmKIW7NCBig5Dht5VkGDqDZieUVsAv2qfrlf-Q Aug 31 12:35:28.855738 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:35:28.855738 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:35:28.855738 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:35:28.855738 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:35:28.855738 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:35:28.855738 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:35:28.855738 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: b364169c30154cc8af7c9a37bebc8040 Aug 31 12:35:28.855738 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-TestVolumeBootPattern-12247139 Aug 31 12:35:28.855738 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:35:28.855738 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:35:28.857484 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b364169c30154cc8af7c9a37bebc8040"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b364169c30154cc8af7c9a37bebc8040", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b364169c30154cc8af7c9a37bebc8040"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b364169c30154cc8af7c9a37bebc8040"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:35:28.857484 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-TestVolumeBootPattern-12247139 Aug 31 12:35:28.857484 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: b364169c30154cc8af7c9a37bebc8040 Aug 31 12:35:28.857484 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-TestVolumeBootPattern-12247139 Aug 31 12:35:28.857484 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-TestVolumeBootPattern-12247139-project Aug 31 12:35:28.857484 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:35:28.857484 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:35:28.857484 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: 2e77671c123f434489d82da79212d0ab Aug 31 12:35:28.857484 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-TestVolumeBootPattern-12247139-project Aug 31 12:35:28.857484 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:35:28.857484 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Instance 688b1262-46e9-4330-b633-05fc6a28cee3 could not be found. Aug 31 12:35:28.857484 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'id': '688b1262-46e9-4330-b633-05fc6a28cee3'} Aug 31 12:35:28.858437 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:35:28.858437 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:35:28.858437 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:35:28.858437 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:35:28.858437 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:35:28.858437 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:35:28.858437 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:35:28.858437 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:35:28.858437 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:35:28.858437 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:35:28.858437 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 688b1262-46e9-4330-b633-05fc6a28cee3 could not be found. Aug 31 12:35:28.858437 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:35:28.858437 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:35:28.858437 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:35:28.858437 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:35:28.858437 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:35:28.858437 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:35:28.858437 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:35:28.858437 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:35:28.858437 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:35:28.860444 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:35:28.860444 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:35:28.860444 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:35:28.860444 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:35:28.860444 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:35:28.860444 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:35:28.860444 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:35:28.860444 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 688b1262-46e9-4330-b633-05fc6a28cee3 could not be found. Aug 31 12:35:28.860444 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:35:28.860444 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:35:28.860444 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:35:28.860444 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:35:28.860444 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:35:28.860444 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:35:28.860444 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:35:28.860444 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:35:28.860444 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 688b1262-46e9-4330-b633-05fc6a28cee3 could not be found. Aug 31 12:35:28.860444 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:35:28.862301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-8af6df43-43dc-4721-94e7-a1cb18fdf869 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Returning 404 to user: Instance 688b1262-46e9-4330-b633-05fc6a28cee3 could not be found. {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:35:28.862301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-8af6df43-43dc-4721-94e7-a1cb18fdf869 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 404 len: 111 microversion: 2.1 time: 0.085320 Aug 31 12:35:28.874682 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 289/585] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:28 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:35:29.098844 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-91e0f4c9-7899-4251-b7a9-5268183bcc0b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-58678186", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-280733761", "security_groups": [{"name": "tempest-secgroup-smoke-1147286286"}], "block_device_mapping_v2": [{"uuid": "1335fee3-6344-429c-8323-704764084bb0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bb498262-cecd-4350-a5a0-432fdf03b76c"}]}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:35:29.305352 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.network.neutron [None req-91e0f4c9-7899-4251-b7a9-5268183bcc0b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] validate_networks() for [('bb498262-cecd-4350-a5a0-432fdf03b76c', None, None, None, None, None)] {{(pid=120749) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:35:29.508853 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-55db2a09-2095-46d5-b2b7-1e925a95e6b3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:29.509459 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-55db2a09-2095-46d5-b2b7-1e925a95e6b3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:29.517353 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-55db2a09-2095-46d5-b2b7-1e925a95e6b3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:29.517846 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-55db2a09-2095-46d5-b2b7-1e925a95e6b3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:29.518275 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-55db2a09-2095-46d5-b2b7-1e925a95e6b3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:29.519944 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-55db2a09-2095-46d5-b2b7-1e925a95e6b3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:29.520078 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-55db2a09-2095-46d5-b2b7-1e925a95e6b3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:29.520437 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-55db2a09-2095-46d5-b2b7-1e925a95e6b3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:29.856589 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-55db2a09-2095-46d5-b2b7-1e925a95e6b3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:29.866685 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-55db2a09-2095-46d5-b2b7-1e925a95e6b3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:29.871282 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-55db2a09-2095-46d5-b2b7-1e925a95e6b3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:29.873571 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-55db2a09-2095-46d5-b2b7-1e925a95e6b3 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1740 microversion: 2.20 time: 0.368611 Aug 31 12:35:29.874742 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 290/586] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:29 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1740 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:35:30.245638 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-91e0f4c9-7899-4251-b7a9-5268183bcc0b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Flavor limits 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:35:30.247396 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-91e0f4c9-7899-4251-b7a9-5268183bcc0b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Image limits 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:35:30.247396 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-91e0f4c9-7899-4251-b7a9-5268183bcc0b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Flavor pref 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:35:30.247629 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-91e0f4c9-7899-4251-b7a9-5268183bcc0b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Image pref 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:35:30.248150 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-91e0f4c9-7899-4251-b7a9-5268183bcc0b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:35:30.250963 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:30.263478 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-91e0f4c9-7899-4251-b7a9-5268183bcc0b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:30.263967 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-91e0f4c9-7899-4251-b7a9-5268183bcc0b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:30.264390 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-91e0f4c9-7899-4251-b7a9-5268183bcc0b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:30.265311 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-91e0f4c9-7899-4251-b7a9-5268183bcc0b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:30.265937 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-91e0f4c9-7899-4251-b7a9-5268183bcc0b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:30.266522 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-91e0f4c9-7899-4251-b7a9-5268183bcc0b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:30.301178 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-91e0f4c9-7899-4251-b7a9-5268183bcc0b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Getting quotas for project b364169c30154cc8af7c9a37bebc8040. Resources: {'cores', 'ram', 'instances'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:35:30.307605 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-91e0f4c9-7899-4251-b7a9-5268183bcc0b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Getting quotas for user 2e77671c123f434489d82da79212d0ab and project b364169c30154cc8af7c9a37bebc8040. Resources: {'cores', 'ram', 'instances'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:35:30.349036 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-ffb22c1d-da9c-4eab-bdb0-1a5860cfe3c2 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "159132ff-86a7-4aad-8fca-bee3653f91e3"}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:35:30.351645 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-ffb22c1d-da9c-4eab-bdb0-1a5860cfe3c2 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:30.362955 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ffb22c1d-da9c-4eab-bdb0-1a5860cfe3c2 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:30.363715 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ffb22c1d-da9c-4eab-bdb0-1a5860cfe3c2 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:30.364367 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ffb22c1d-da9c-4eab-bdb0-1a5860cfe3c2 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:30.365082 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ffb22c1d-da9c-4eab-bdb0-1a5860cfe3c2 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:30.365538 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ffb22c1d-da9c-4eab-bdb0-1a5860cfe3c2 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:30.365959 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ffb22c1d-da9c-4eab-bdb0-1a5860cfe3c2 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:30.404843 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-91e0f4c9-7899-4251-b7a9-5268183bcc0b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Going to run 1 instances... {{(pid=120749) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:35:30.407082 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-91e0f4c9-7899-4251-b7a9-5268183bcc0b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1335fee3-6344-429c-8323-704764084bb0',volume_size=None,volume_type=None)] {{(pid=120749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:35:30.644749 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-91e0f4c9-7899-4251-b7a9-5268183bcc0b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.550762 Aug 31 12:35:30.648858 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 297/587] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 31 12:35:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 1556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:35:30.660512 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-84138c9e-a894-4f25-bd89-77813acac5c3 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:30.661117 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-84138c9e-a894-4f25-bd89-77813acac5c3 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:30.730488 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-84138c9e-a894-4f25-bd89-77813acac5c3 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:30.737733 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-84138c9e-a894-4f25-bd89-77813acac5c3 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 200 len: 1092 microversion: 2.1 time: 0.081575 Aug 31 12:35:30.739469 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 298/588] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:30 2022] GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 1092 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:30.758812 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-ffb22c1d-da9c-4eab-bdb0-1a5860cfe3c2 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "POST /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.411283 Aug 31 12:35:30.760270 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 291/589] 10.222.0.79 () {60 vars in 1323 bytes} [Wed Aug 31 12:35:30 2022] POST /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f/os-volume_attachments => generated 194 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:35:30.898912 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-88fdb243-8802-4c47-a898-62f33871d940 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:30.899813 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-88fdb243-8802-4c47-a898-62f33871d940 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:30.910571 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-88fdb243-8802-4c47-a898-62f33871d940 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:30.911100 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-88fdb243-8802-4c47-a898-62f33871d940 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:30.911725 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-88fdb243-8802-4c47-a898-62f33871d940 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:30.912430 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-88fdb243-8802-4c47-a898-62f33871d940 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:30.912894 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-88fdb243-8802-4c47-a898-62f33871d940 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:30.913297 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-88fdb243-8802-4c47-a898-62f33871d940 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:31.104993 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-88fdb243-8802-4c47-a898-62f33871d940 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:31.116970 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-88fdb243-8802-4c47-a898-62f33871d940 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:31.118985 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-88fdb243-8802-4c47-a898-62f33871d940 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:31.120819 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-88fdb243-8802-4c47-a898-62f33871d940 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1740 microversion: 2.20 time: 0.227063 Aug 31 12:35:31.135997 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 299/590] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:30 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1740 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:31.760185 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-c830dc95-39e1-47d9-9f89-0eb604b50986 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:31.761600 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-c830dc95-39e1-47d9-9f89-0eb604b50986 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:31.770200 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c830dc95-39e1-47d9-9f89-0eb604b50986 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:31.770788 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c830dc95-39e1-47d9-9f89-0eb604b50986 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:31.771323 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c830dc95-39e1-47d9-9f89-0eb604b50986 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:31.772088 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c830dc95-39e1-47d9-9f89-0eb604b50986 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:31.772599 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c830dc95-39e1-47d9-9f89-0eb604b50986 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:31.773238 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c830dc95-39e1-47d9-9f89-0eb604b50986 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:31.849726 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-c830dc95-39e1-47d9-9f89-0eb604b50986 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:31.858336 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-c830dc95-39e1-47d9-9f89-0eb604b50986 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 200 len: 1190 microversion: 2.1 time: 0.102821 Aug 31 12:35:31.873473 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 292/591] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:31 2022] GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 1190 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:32.145846 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-a32aba2d-8d75-4611-9d18-6a2ae1e3eb5a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:32.146647 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-a32aba2d-8d75-4611-9d18-6a2ae1e3eb5a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:32.153085 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a32aba2d-8d75-4611-9d18-6a2ae1e3eb5a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:32.153580 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a32aba2d-8d75-4611-9d18-6a2ae1e3eb5a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:32.154016 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a32aba2d-8d75-4611-9d18-6a2ae1e3eb5a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:32.154942 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a32aba2d-8d75-4611-9d18-6a2ae1e3eb5a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:32.155406 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a32aba2d-8d75-4611-9d18-6a2ae1e3eb5a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:32.155831 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a32aba2d-8d75-4611-9d18-6a2ae1e3eb5a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:32.299153 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-a32aba2d-8d75-4611-9d18-6a2ae1e3eb5a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:32.308565 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-a32aba2d-8d75-4611-9d18-6a2ae1e3eb5a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:32.310003 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-a32aba2d-8d75-4611-9d18-6a2ae1e3eb5a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:32.311225 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-a32aba2d-8d75-4611-9d18-6a2ae1e3eb5a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1740 microversion: 2.20 time: 0.169421 Aug 31 12:35:32.311795 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 300/592] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:32 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:32.880991 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-08d95642-ffa1-4a2c-88ae-406924d077c9 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:32.882036 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-08d95642-ffa1-4a2c-88ae-406924d077c9 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:32.889086 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-08d95642-ffa1-4a2c-88ae-406924d077c9 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:32.889747 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-08d95642-ffa1-4a2c-88ae-406924d077c9 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:32.890295 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-08d95642-ffa1-4a2c-88ae-406924d077c9 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:32.891317 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-08d95642-ffa1-4a2c-88ae-406924d077c9 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:32.891831 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-08d95642-ffa1-4a2c-88ae-406924d077c9 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:32.892427 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-08d95642-ffa1-4a2c-88ae-406924d077c9 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:33.143224 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-08d95642-ffa1-4a2c-88ae-406924d077c9 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:33.151012 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-08d95642-ffa1-4a2c-88ae-406924d077c9 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 200 len: 1276 microversion: 2.1 time: 0.274644 Aug 31 12:35:33.152130 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 293/593] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:32 2022] GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 1276 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:33.335320 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-67f963ab-a9f8-4aa1-afd6-1ac6e59dd708 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:33.336343 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-67f963ab-a9f8-4aa1-afd6-1ac6e59dd708 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:33.344784 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-67f963ab-a9f8-4aa1-afd6-1ac6e59dd708 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:33.345438 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-67f963ab-a9f8-4aa1-afd6-1ac6e59dd708 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:33.345978 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-67f963ab-a9f8-4aa1-afd6-1ac6e59dd708 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:33.347632 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-67f963ab-a9f8-4aa1-afd6-1ac6e59dd708 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:33.347632 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-67f963ab-a9f8-4aa1-afd6-1ac6e59dd708 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:33.348888 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-67f963ab-a9f8-4aa1-afd6-1ac6e59dd708 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:33.509225 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-67f963ab-a9f8-4aa1-afd6-1ac6e59dd708 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:33.520063 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-67f963ab-a9f8-4aa1-afd6-1ac6e59dd708 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:33.522398 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-67f963ab-a9f8-4aa1-afd6-1ac6e59dd708 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:33.523420 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-67f963ab-a9f8-4aa1-afd6-1ac6e59dd708 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1722 microversion: 2.20 time: 0.193229 Aug 31 12:35:33.524226 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 301/594] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:33 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:33.726662 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-e1e143bb-c04f-48ee-8701-d61d001b00d5 req-17296bb3-17b7-4e38-8c26-41cad0c10e54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf8dc60e-6168-4d8a-b00a-56d3df39acc1", "tag": "5ee12b57-c6ee-4824-a0bc-c435d577bbdd"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:35:33.736903 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-e1e143bb-c04f-48ee-8701-d61d001b00d5 req-17296bb3-17b7-4e38-8c26-41cad0c10e54 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:33.738287 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-e1e143bb-c04f-48ee-8701-d61d001b00d5 req-17296bb3-17b7-4e38-8c26-41cad0c10e54 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:33.739228 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-e1e143bb-c04f-48ee-8701-d61d001b00d5 req-17296bb3-17b7-4e38-8c26-41cad0c10e54 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:33.750221 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-e1e143bb-c04f-48ee-8701-d61d001b00d5 req-17296bb3-17b7-4e38-8c26-41cad0c10e54 service nova] Creating event network-changed:5ee12b57-c6ee-4824-a0bc-c435d577bbdd for instance bf8dc60e-6168-4d8a-b00a-56d3df39acc1 on hv-cinder-85528 Aug 31 12:35:33.756170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-e1e143bb-c04f-48ee-8701-d61d001b00d5 req-17296bb3-17b7-4e38-8c26-41cad0c10e54 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033116 Aug 31 12:35:33.757017 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 294/595] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:35:34.173699 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-36c47bc3-82d5-47e6-947f-9cd041b40edc tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:34.174315 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-36c47bc3-82d5-47e6-947f-9cd041b40edc tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:34.180762 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-36c47bc3-82d5-47e6-947f-9cd041b40edc tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:34.181263 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-36c47bc3-82d5-47e6-947f-9cd041b40edc tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:34.181701 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-36c47bc3-82d5-47e6-947f-9cd041b40edc tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:34.182406 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-36c47bc3-82d5-47e6-947f-9cd041b40edc tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:34.182888 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-36c47bc3-82d5-47e6-947f-9cd041b40edc tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:34.183319 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-36c47bc3-82d5-47e6-947f-9cd041b40edc tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:34.332566 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-36c47bc3-82d5-47e6-947f-9cd041b40edc tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:34.340412 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-36c47bc3-82d5-47e6-947f-9cd041b40edc tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 200 len: 1276 microversion: 2.1 time: 0.170840 Aug 31 12:35:34.341024 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 302/596] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:34 2022] GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 1276 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:34.548473 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-5d89708d-490e-4bc1-b3b0-38cf51452cbc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:34.549297 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-5d89708d-490e-4bc1-b3b0-38cf51452cbc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:34.556143 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5d89708d-490e-4bc1-b3b0-38cf51452cbc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:34.556631 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5d89708d-490e-4bc1-b3b0-38cf51452cbc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:34.557067 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5d89708d-490e-4bc1-b3b0-38cf51452cbc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:34.557760 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5d89708d-490e-4bc1-b3b0-38cf51452cbc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:34.558214 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5d89708d-490e-4bc1-b3b0-38cf51452cbc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:34.558637 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5d89708d-490e-4bc1-b3b0-38cf51452cbc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:34.573574 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:34.866557 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-5d89708d-490e-4bc1-b3b0-38cf51452cbc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:34.875140 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-5d89708d-490e-4bc1-b3b0-38cf51452cbc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:34.876675 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-5d89708d-490e-4bc1-b3b0-38cf51452cbc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:34.878367 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-5d89708d-490e-4bc1-b3b0-38cf51452cbc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1722 microversion: 2.20 time: 0.333877 Aug 31 12:35:34.879315 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 295/597] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:34 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1722 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:35.361856 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-86d1f14d-c46e-4680-8e90-b1e9570a007b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:35.363704 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-86d1f14d-c46e-4680-8e90-b1e9570a007b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:35.370381 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-86d1f14d-c46e-4680-8e90-b1e9570a007b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:35.371231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-86d1f14d-c46e-4680-8e90-b1e9570a007b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:35.371719 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-86d1f14d-c46e-4680-8e90-b1e9570a007b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:35.372493 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-86d1f14d-c46e-4680-8e90-b1e9570a007b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:35.373020 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-86d1f14d-c46e-4680-8e90-b1e9570a007b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:35.373515 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-86d1f14d-c46e-4680-8e90-b1e9570a007b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:35.424505 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-38b82c2a-ffb9-4989-9502-3d24997195f7 req-5df458f4-3f4e-47b6-a975-5ad6260a5a00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bee1640-e8d5-48a7-b437-414aac42397a", "name": "network-vif-unplugged", "status": "completed", "tag": "b673aa1b-a57f-46f1-bb92-bd62f55d451c"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:35:35.440813 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-38b82c2a-ffb9-4989-9502-3d24997195f7 req-5df458f4-3f4e-47b6-a975-5ad6260a5a00 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:35.441328 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-38b82c2a-ffb9-4989-9502-3d24997195f7 req-5df458f4-3f4e-47b6-a975-5ad6260a5a00 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:35.446002 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-38b82c2a-ffb9-4989-9502-3d24997195f7 req-5df458f4-3f4e-47b6-a975-5ad6260a5a00 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:35.462288 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.compute.server_external_events [req-38b82c2a-ffb9-4989-9502-3d24997195f7 req-5df458f4-3f4e-47b6-a975-5ad6260a5a00 service nova] Unable to find a host for instance 8bee1640-e8d5-48a7-b437-414aac42397a. Dropping event network-vif-unplugged {{(pid=120750) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 12:35:35.463484 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-38b82c2a-ffb9-4989-9502-3d24997195f7 req-5df458f4-3f4e-47b6-a975-5ad6260a5a00 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.043602 Aug 31 12:35:35.464610 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 296/598] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 45 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 31 12:35:35.545541 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-86d1f14d-c46e-4680-8e90-b1e9570a007b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:35.554214 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-86d1f14d-c46e-4680-8e90-b1e9570a007b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 200 len: 1276 microversion: 2.1 time: 0.197064 Aug 31 12:35:35.554916 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 303/599] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:35 2022] GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 1276 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:35.902483 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-174148ff-2f2e-45ae-b1ee-eb154439ccf1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:35.903156 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-174148ff-2f2e-45ae-b1ee-eb154439ccf1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:35.910971 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-174148ff-2f2e-45ae-b1ee-eb154439ccf1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:35.911467 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-174148ff-2f2e-45ae-b1ee-eb154439ccf1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:35.911905 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-174148ff-2f2e-45ae-b1ee-eb154439ccf1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:35.912599 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-174148ff-2f2e-45ae-b1ee-eb154439ccf1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:35.913087 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-174148ff-2f2e-45ae-b1ee-eb154439ccf1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:35.913512 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-174148ff-2f2e-45ae-b1ee-eb154439ccf1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:36.047509 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-174148ff-2f2e-45ae-b1ee-eb154439ccf1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:36.056568 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-174148ff-2f2e-45ae-b1ee-eb154439ccf1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:36.057986 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-174148ff-2f2e-45ae-b1ee-eb154439ccf1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:36.059166 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-174148ff-2f2e-45ae-b1ee-eb154439ccf1 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1665 microversion: 2.20 time: 0.160561 Aug 31 12:35:36.059723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 297/600] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:35 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1665 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:36.081350 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-ab130522-0558-4827-a5f9-ae01343e4c06 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7cee6e06-492a-4b06-9d0b-cc16eb46bcd7"}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:35:36.083843 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-ab130522-0558-4827-a5f9-ae01343e4c06 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:36.089771 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ab130522-0558-4827-a5f9-ae01343e4c06 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:36.090257 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ab130522-0558-4827-a5f9-ae01343e4c06 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:36.090694 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ab130522-0558-4827-a5f9-ae01343e4c06 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:36.091405 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ab130522-0558-4827-a5f9-ae01343e4c06 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:36.091862 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ab130522-0558-4827-a5f9-ae01343e4c06 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:36.092286 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ab130522-0558-4827-a5f9-ae01343e4c06 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:36.172456 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:36.385558 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-ab130522-0558-4827-a5f9-ae01343e4c06 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "POST /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.308112 Aug 31 12:35:36.386499 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 304/601] 10.222.0.79 () {62 vars in 1364 bytes} [Wed Aug 31 12:35:36 2022] POST /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a/os-volume_attachments => generated 188 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:35:36.512315 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-441c227a-7fb0-4a92-ae54-d69959358ed4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:36.512794 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-441c227a-7fb0-4a92-ae54-d69959358ed4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:36.519088 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-441c227a-7fb0-4a92-ae54-d69959358ed4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:36.519559 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-441c227a-7fb0-4a92-ae54-d69959358ed4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:36.519987 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-441c227a-7fb0-4a92-ae54-d69959358ed4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:36.520664 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-441c227a-7fb0-4a92-ae54-d69959358ed4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:36.521107 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-441c227a-7fb0-4a92-ae54-d69959358ed4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:36.521519 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-441c227a-7fb0-4a92-ae54-d69959358ed4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:36.574567 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-e2e47804-8be5-4fcf-8218-b10695319e05 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:36.575215 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-e2e47804-8be5-4fcf-8218-b10695319e05 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:36.582302 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2e47804-8be5-4fcf-8218-b10695319e05 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:36.582912 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2e47804-8be5-4fcf-8218-b10695319e05 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:36.583648 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2e47804-8be5-4fcf-8218-b10695319e05 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:36.584353 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2e47804-8be5-4fcf-8218-b10695319e05 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:36.584931 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2e47804-8be5-4fcf-8218-b10695319e05 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:36.585357 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2e47804-8be5-4fcf-8218-b10695319e05 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:36.741738 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-e2e47804-8be5-4fcf-8218-b10695319e05 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:36.751098 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-e2e47804-8be5-4fcf-8218-b10695319e05 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 200 len: 1276 microversion: 2.1 time: 0.180141 Aug 31 12:35:36.765941 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 305/602] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:36 2022] GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 1276 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:36.792601 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-441c227a-7fb0-4a92-ae54-d69959358ed4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a/os-volume_attachments/7cee6e06-492a-4b06-9d0b-cc16eb46bcd7" status: 202 len: 0 microversion: 2.20 time: 0.284015 Aug 31 12:35:36.793212 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 298/603] 10.222.0.79 () {60 vars in 1457 bytes} [Wed Aug 31 12:35:36 2022] DELETE /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a/os-volume_attachments/7cee6e06-492a-4b06-9d0b-cc16eb46bcd7 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:35:36.856144 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-d7a91d55-3fc5-45e0-9826-3cabb3b00ea2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:35:36.856793 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-d7a91d55-3fc5-45e0-9826-3cabb3b00ea2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:36.863761 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d7a91d55-3fc5-45e0-9826-3cabb3b00ea2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:36.864261 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d7a91d55-3fc5-45e0-9826-3cabb3b00ea2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:36.864704 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d7a91d55-3fc5-45e0-9826-3cabb3b00ea2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:36.865410 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d7a91d55-3fc5-45e0-9826-3cabb3b00ea2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:36.865870 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d7a91d55-3fc5-45e0-9826-3cabb3b00ea2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:36.866297 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d7a91d55-3fc5-45e0-9826-3cabb3b00ea2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:36.897282 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-d7a91d55-3fc5-45e0-9826-3cabb3b00ea2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120749) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 12:35:36.979014 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-d7a91d55-3fc5-45e0-9826-3cabb3b00ea2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "POST /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a/action" status: 202 len: 0 microversion: 2.20 time: 0.126681 Aug 31 12:35:36.980004 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 306/604] 10.222.0.79 () {62 vars in 1319 bytes} [Wed Aug 31 12:35:36 2022] POST /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:35:36.991777 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-003c640d-d698-4151-98f9-dd1c7f898332 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:36.994426 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-003c640d-d698-4151-98f9-dd1c7f898332 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:37.004802 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-003c640d-d698-4151-98f9-dd1c7f898332 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:37.005247 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-003c640d-d698-4151-98f9-dd1c7f898332 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:37.005673 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-003c640d-d698-4151-98f9-dd1c7f898332 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:37.006370 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-003c640d-d698-4151-98f9-dd1c7f898332 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:37.006822 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-003c640d-d698-4151-98f9-dd1c7f898332 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:37.007307 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-003c640d-d698-4151-98f9-dd1c7f898332 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:37.222868 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-003c640d-d698-4151-98f9-dd1c7f898332 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:37.232222 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-003c640d-d698-4151-98f9-dd1c7f898332 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:37.233875 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-003c640d-d698-4151-98f9-dd1c7f898332 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:37.235108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-003c640d-d698-4151-98f9-dd1c7f898332 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1673 microversion: 2.20 time: 0.250381 Aug 31 12:35:37.235656 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 299/605] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:36 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1673 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:37.777364 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-de5c1907-5df3-49e7-9504-f38cd066b966 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:37.778605 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-de5c1907-5df3-49e7-9504-f38cd066b966 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:37.787662 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-de5c1907-5df3-49e7-9504-f38cd066b966 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:37.788153 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-de5c1907-5df3-49e7-9504-f38cd066b966 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:37.788710 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-de5c1907-5df3-49e7-9504-f38cd066b966 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:37.789412 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-de5c1907-5df3-49e7-9504-f38cd066b966 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:37.789862 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-de5c1907-5df3-49e7-9504-f38cd066b966 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:37.790282 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-de5c1907-5df3-49e7-9504-f38cd066b966 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:37.952468 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-de5c1907-5df3-49e7-9504-f38cd066b966 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:37.962420 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-de5c1907-5df3-49e7-9504-f38cd066b966 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 200 len: 1276 microversion: 2.1 time: 0.192739 Aug 31 12:35:37.963036 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 307/606] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:37 2022] GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 1276 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:38.259209 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-81304a22-7c3c-4caa-a15f-0236a3514e4d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:38.259803 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-81304a22-7c3c-4caa-a15f-0236a3514e4d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:38.266250 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-81304a22-7c3c-4caa-a15f-0236a3514e4d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:38.266726 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-81304a22-7c3c-4caa-a15f-0236a3514e4d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:38.267183 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-81304a22-7c3c-4caa-a15f-0236a3514e4d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:38.267866 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-81304a22-7c3c-4caa-a15f-0236a3514e4d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:38.268325 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-81304a22-7c3c-4caa-a15f-0236a3514e4d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:38.268742 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-81304a22-7c3c-4caa-a15f-0236a3514e4d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:38.428772 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-81de3b98-c6c8-4d1c-959e-ca910ee179b6 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:38.431248 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-81de3b98-c6c8-4d1c-959e-ca910ee179b6 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:38.439119 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-81de3b98-c6c8-4d1c-959e-ca910ee179b6 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:38.439631 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-81de3b98-c6c8-4d1c-959e-ca910ee179b6 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:38.440260 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-81de3b98-c6c8-4d1c-959e-ca910ee179b6 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:38.441654 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-81de3b98-c6c8-4d1c-959e-ca910ee179b6 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:38.447068 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-81de3b98-c6c8-4d1c-959e-ca910ee179b6 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:38.447780 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-81de3b98-c6c8-4d1c-959e-ca910ee179b6 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:38.484019 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-81de3b98-c6c8-4d1c-959e-ca910ee179b6 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.059852 Aug 31 12:35:38.484515 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 308/607] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 31 12:35:38 2022] GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f/os-volume_attachments => generated 371 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:35:38.509531 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-81304a22-7c3c-4caa-a15f-0236a3514e4d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:38.518379 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-81304a22-7c3c-4caa-a15f-0236a3514e4d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:38.521186 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-81304a22-7c3c-4caa-a15f-0236a3514e4d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:38.522393 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-81304a22-7c3c-4caa-a15f-0236a3514e4d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1731 microversion: 2.20 time: 0.267223 Aug 31 12:35:38.522987 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 300/608] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:38 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1731 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:38.667890 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-d68370f4-0a6b-446b-80a7-4cc85f750dee tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:38.668662 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-d68370f4-0a6b-446b-80a7-4cc85f750dee tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:38.674552 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d68370f4-0a6b-446b-80a7-4cc85f750dee tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:38.675666 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d68370f4-0a6b-446b-80a7-4cc85f750dee tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:38.676305 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d68370f4-0a6b-446b-80a7-4cc85f750dee tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:38.677160 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d68370f4-0a6b-446b-80a7-4cc85f750dee tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:38.677620 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d68370f4-0a6b-446b-80a7-4cc85f750dee tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:38.678047 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d68370f4-0a6b-446b-80a7-4cc85f750dee tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:38.708346 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-d68370f4-0a6b-446b-80a7-4cc85f750dee tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f/os-volume_attachments/97ad22dd-b4c4-43c2-9bec-bd4b1829a8fb" status: 200 len: 194 microversion: 2.1 time: 0.044441 Aug 31 12:35:38.708947 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 309/609] 10.222.0.79 () {58 vars in 1413 bytes} [Wed Aug 31 12:35:38 2022] GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f/os-volume_attachments/97ad22dd-b4c4-43c2-9bec-bd4b1829a8fb => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:35:38.719251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b214f229-4782-4e2a-a97c-850e637c7094 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:38.719739 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-b214f229-4782-4e2a-a97c-850e637c7094 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:38.725758 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b214f229-4782-4e2a-a97c-850e637c7094 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:38.726240 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b214f229-4782-4e2a-a97c-850e637c7094 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:38.726666 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b214f229-4782-4e2a-a97c-850e637c7094 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:38.727397 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b214f229-4782-4e2a-a97c-850e637c7094 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:38.727846 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b214f229-4782-4e2a-a97c-850e637c7094 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:38.728303 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b214f229-4782-4e2a-a97c-850e637c7094 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:38.812261 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.objects.instance [None req-b214f229-4782-4e2a-a97c-850e637c7094 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lazy-loading 'services' on Instance uuid 03c55128-ac55-4678-84c2-33c5ce3b426f {{(pid=120750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:35:38.887701 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b214f229-4782-4e2a-a97c-850e637c7094 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "DELETE /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f/os-volume_attachments/97ad22dd-b4c4-43c2-9bec-bd4b1829a8fb" status: 202 len: 0 microversion: 2.1 time: 0.172150 Aug 31 12:35:38.888567 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 301/610] 10.222.0.79 () {58 vars in 1416 bytes} [Wed Aug 31 12:35:38 2022] DELETE /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f/os-volume_attachments/97ad22dd-b4c4-43c2-9bec-bd4b1829a8fb => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:35:38.984046 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-bec091dd-5df0-436f-873f-efc562fedc7a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:38.984894 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-bec091dd-5df0-436f-873f-efc562fedc7a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:38.995011 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bec091dd-5df0-436f-873f-efc562fedc7a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:38.995357 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bec091dd-5df0-436f-873f-efc562fedc7a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:38.995809 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bec091dd-5df0-436f-873f-efc562fedc7a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:38.996546 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bec091dd-5df0-436f-873f-efc562fedc7a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:38.997048 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bec091dd-5df0-436f-873f-efc562fedc7a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:38.997477 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bec091dd-5df0-436f-873f-efc562fedc7a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:39.135305 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-bec091dd-5df0-436f-873f-efc562fedc7a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:39.143081 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-bec091dd-5df0-436f-873f-efc562fedc7a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 200 len: 1264 microversion: 2.1 time: 0.163366 Aug 31 12:35:39.143632 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 310/611] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:38 2022] GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:39.546580 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-262fcc49-ed57-427b-8726-2526275c993d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:39.547354 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-262fcc49-ed57-427b-8726-2526275c993d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:39.556109 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-262fcc49-ed57-427b-8726-2526275c993d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:39.556871 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-262fcc49-ed57-427b-8726-2526275c993d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:39.557458 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-262fcc49-ed57-427b-8726-2526275c993d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:39.558314 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-262fcc49-ed57-427b-8726-2526275c993d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:39.558934 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-262fcc49-ed57-427b-8726-2526275c993d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:39.559501 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-262fcc49-ed57-427b-8726-2526275c993d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:39.768039 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-262fcc49-ed57-427b-8726-2526275c993d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:39.782087 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-262fcc49-ed57-427b-8726-2526275c993d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:39.789324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-262fcc49-ed57-427b-8726-2526275c993d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:39.793189 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-262fcc49-ed57-427b-8726-2526275c993d tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1731 microversion: 2.20 time: 0.250125 Aug 31 12:35:39.795777 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 302/612] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:39 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1731 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:40.165578 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-0619e838-b87b-4c43-a876-19e423032f64 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:40.166231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-0619e838-b87b-4c43-a876-19e423032f64 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:40.172834 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0619e838-b87b-4c43-a876-19e423032f64 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:40.173317 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0619e838-b87b-4c43-a876-19e423032f64 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:40.173751 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0619e838-b87b-4c43-a876-19e423032f64 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:40.174449 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0619e838-b87b-4c43-a876-19e423032f64 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:40.174924 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0619e838-b87b-4c43-a876-19e423032f64 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:40.175350 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0619e838-b87b-4c43-a876-19e423032f64 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:40.278517 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=2 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:40.326141 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-0619e838-b87b-4c43-a876-19e423032f64 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:40.334619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-0619e838-b87b-4c43-a876-19e423032f64 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 200 len: 1264 microversion: 2.1 time: 0.173529 Aug 31 12:35:40.335814 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 311/613] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:40 2022] GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:40.822106 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-347c367b-e298-4c7c-8588-ac6c86d92763 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:40.823040 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-347c367b-e298-4c7c-8588-ac6c86d92763 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:40.830801 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-347c367b-e298-4c7c-8588-ac6c86d92763 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:40.831578 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-347c367b-e298-4c7c-8588-ac6c86d92763 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:40.832149 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-347c367b-e298-4c7c-8588-ac6c86d92763 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:40.833937 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-347c367b-e298-4c7c-8588-ac6c86d92763 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:40.834547 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-347c367b-e298-4c7c-8588-ac6c86d92763 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:40.835056 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-347c367b-e298-4c7c-8588-ac6c86d92763 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:41.004739 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-347c367b-e298-4c7c-8588-ac6c86d92763 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:41.014539 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-347c367b-e298-4c7c-8588-ac6c86d92763 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:41.016363 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-347c367b-e298-4c7c-8588-ac6c86d92763 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:41.017741 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-347c367b-e298-4c7c-8588-ac6c86d92763 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1731 microversion: 2.20 time: 0.202451 Aug 31 12:35:41.018606 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 303/614] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:40 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1731 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:41.355952 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-296f499d-2583-433c-8cbe-ef173f3620ad tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:41.356545 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-296f499d-2583-433c-8cbe-ef173f3620ad tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:41.359783 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=8 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:41.366159 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-296f499d-2583-433c-8cbe-ef173f3620ad tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:41.366769 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-296f499d-2583-433c-8cbe-ef173f3620ad tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:41.367325 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-296f499d-2583-433c-8cbe-ef173f3620ad tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:41.368123 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-296f499d-2583-433c-8cbe-ef173f3620ad tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:41.368651 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-296f499d-2583-433c-8cbe-ef173f3620ad tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:41.369173 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-296f499d-2583-433c-8cbe-ef173f3620ad tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:41.558153 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-296f499d-2583-433c-8cbe-ef173f3620ad tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:41.568278 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-296f499d-2583-433c-8cbe-ef173f3620ad tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 200 len: 1264 microversion: 2.1 time: 0.215489 Aug 31 12:35:41.569545 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 312/615] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:41 2022] GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 1264 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:42.054079 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-4dc62c78-7614-4392-9663-95bdca4ae84a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:42.054910 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-4dc62c78-7614-4392-9663-95bdca4ae84a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:42.062408 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4dc62c78-7614-4392-9663-95bdca4ae84a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:42.063197 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4dc62c78-7614-4392-9663-95bdca4ae84a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:42.063634 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4dc62c78-7614-4392-9663-95bdca4ae84a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:42.064341 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4dc62c78-7614-4392-9663-95bdca4ae84a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:42.064794 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4dc62c78-7614-4392-9663-95bdca4ae84a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:42.065217 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4dc62c78-7614-4392-9663-95bdca4ae84a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:42.269294 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-4dc62c78-7614-4392-9663-95bdca4ae84a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:42.292357 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-4dc62c78-7614-4392-9663-95bdca4ae84a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:42.295533 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-4dc62c78-7614-4392-9663-95bdca4ae84a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:42.297740 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-4dc62c78-7614-4392-9663-95bdca4ae84a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1731 microversion: 2.20 time: 0.247629 Aug 31 12:35:42.298782 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 304/616] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:42 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1731 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:42.602357 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-c7da8752-5031-437a-9001-dacdd9de8b83 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:42.604838 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-c7da8752-5031-437a-9001-dacdd9de8b83 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:42.615957 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c7da8752-5031-437a-9001-dacdd9de8b83 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:42.616456 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c7da8752-5031-437a-9001-dacdd9de8b83 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:42.616888 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c7da8752-5031-437a-9001-dacdd9de8b83 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:42.617593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c7da8752-5031-437a-9001-dacdd9de8b83 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:42.618259 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c7da8752-5031-437a-9001-dacdd9de8b83 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:42.618682 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c7da8752-5031-437a-9001-dacdd9de8b83 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:42.759110 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-c7da8752-5031-437a-9001-dacdd9de8b83 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:42.766986 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-c7da8752-5031-437a-9001-dacdd9de8b83 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 200 len: 1264 microversion: 2.1 time: 0.168660 Aug 31 12:35:42.767555 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 313/617] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:42 2022] GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:43.323745 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-ff407229-7642-42d1-be42-ac5bf82a0460 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:43.324601 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-ff407229-7642-42d1-be42-ac5bf82a0460 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:43.330933 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ff407229-7642-42d1-be42-ac5bf82a0460 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:43.331785 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ff407229-7642-42d1-be42-ac5bf82a0460 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:43.332450 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ff407229-7642-42d1-be42-ac5bf82a0460 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:43.333412 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ff407229-7642-42d1-be42-ac5bf82a0460 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:43.335015 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ff407229-7642-42d1-be42-ac5bf82a0460 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:43.335719 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ff407229-7642-42d1-be42-ac5bf82a0460 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:43.486465 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-ff407229-7642-42d1-be42-ac5bf82a0460 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:43.498128 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-ff407229-7642-42d1-be42-ac5bf82a0460 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:43.500296 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-ff407229-7642-42d1-be42-ac5bf82a0460 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:43.502276 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-ff407229-7642-42d1-be42-ac5bf82a0460 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1731 microversion: 2.20 time: 0.182729 Aug 31 12:35:43.503353 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 305/618] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:43 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:43.796268 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-0038e53c-e698-4499-bd19-27194ffb859b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:43.797022 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-0038e53c-e698-4499-bd19-27194ffb859b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:43.809401 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0038e53c-e698-4499-bd19-27194ffb859b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:43.811589 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0038e53c-e698-4499-bd19-27194ffb859b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:43.812380 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0038e53c-e698-4499-bd19-27194ffb859b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:43.813130 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0038e53c-e698-4499-bd19-27194ffb859b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:43.814082 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0038e53c-e698-4499-bd19-27194ffb859b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:43.814534 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0038e53c-e698-4499-bd19-27194ffb859b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:44.001331 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-0038e53c-e698-4499-bd19-27194ffb859b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:44.015932 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-0038e53c-e698-4499-bd19-27194ffb859b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 200 len: 1264 microversion: 2.1 time: 0.223436 Aug 31 12:35:44.016955 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 314/619] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:43 2022] GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 1264 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:44.526926 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-bc833a85-97b7-4737-8ce1-e45666a5b897 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:44.527658 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-bc833a85-97b7-4737-8ce1-e45666a5b897 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:44.534762 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bc833a85-97b7-4737-8ce1-e45666a5b897 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:44.535394 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bc833a85-97b7-4737-8ce1-e45666a5b897 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:44.535827 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bc833a85-97b7-4737-8ce1-e45666a5b897 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:44.536521 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bc833a85-97b7-4737-8ce1-e45666a5b897 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:44.537152 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bc833a85-97b7-4737-8ce1-e45666a5b897 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:44.537574 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bc833a85-97b7-4737-8ce1-e45666a5b897 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:44.698688 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-bc833a85-97b7-4737-8ce1-e45666a5b897 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:44.712301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-bc833a85-97b7-4737-8ce1-e45666a5b897 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:44.714281 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-bc833a85-97b7-4737-8ce1-e45666a5b897 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:44.716041 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-bc833a85-97b7-4737-8ce1-e45666a5b897 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1731 microversion: 2.20 time: 0.193433 Aug 31 12:35:44.732428 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 306/620] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:44 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1731 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:45.046999 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-f4e226a0-3305-4154-a1e3-1cc658cb6ac2 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:45.046999 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-f4e226a0-3305-4154-a1e3-1cc658cb6ac2 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:45.056605 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f4e226a0-3305-4154-a1e3-1cc658cb6ac2 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:45.057517 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f4e226a0-3305-4154-a1e3-1cc658cb6ac2 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:45.058211 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f4e226a0-3305-4154-a1e3-1cc658cb6ac2 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:45.059507 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f4e226a0-3305-4154-a1e3-1cc658cb6ac2 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:45.060298 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f4e226a0-3305-4154-a1e3-1cc658cb6ac2 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:45.061050 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f4e226a0-3305-4154-a1e3-1cc658cb6ac2 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:45.235510 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-f4e226a0-3305-4154-a1e3-1cc658cb6ac2 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:45.244531 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-f4e226a0-3305-4154-a1e3-1cc658cb6ac2 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 200 len: 1264 microversion: 2.1 time: 0.209318 Aug 31 12:35:45.245153 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 315/621] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:45 2022] GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 1264 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:45.739131 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-1b2f37bf-8787-4446-affa-dd2b032f488c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:45.740413 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-1b2f37bf-8787-4446-affa-dd2b032f488c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:45.747009 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1b2f37bf-8787-4446-affa-dd2b032f488c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:45.747496 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1b2f37bf-8787-4446-affa-dd2b032f488c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:45.747928 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1b2f37bf-8787-4446-affa-dd2b032f488c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:45.748694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1b2f37bf-8787-4446-affa-dd2b032f488c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:45.749147 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1b2f37bf-8787-4446-affa-dd2b032f488c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:45.749560 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1b2f37bf-8787-4446-affa-dd2b032f488c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:45.899138 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-1b2f37bf-8787-4446-affa-dd2b032f488c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:45.910795 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-1b2f37bf-8787-4446-affa-dd2b032f488c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:45.912628 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-1b2f37bf-8787-4446-affa-dd2b032f488c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:45.913774 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-1b2f37bf-8787-4446-affa-dd2b032f488c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1731 microversion: 2.20 time: 0.178942 Aug 31 12:35:45.915120 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 307/622] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:45 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:46.266081 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-99b805de-613b-4ab3-be1a-effb68dcf2c4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:46.266794 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-99b805de-613b-4ab3-be1a-effb68dcf2c4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:46.274341 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-99b805de-613b-4ab3-be1a-effb68dcf2c4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:46.275418 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-99b805de-613b-4ab3-be1a-effb68dcf2c4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:46.276301 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-99b805de-613b-4ab3-be1a-effb68dcf2c4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:46.277275 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-99b805de-613b-4ab3-be1a-effb68dcf2c4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:46.277996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-99b805de-613b-4ab3-be1a-effb68dcf2c4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:46.278599 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-99b805de-613b-4ab3-be1a-effb68dcf2c4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:46.440750 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-99b805de-613b-4ab3-be1a-effb68dcf2c4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:46.449665 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-99b805de-613b-4ab3-be1a-effb68dcf2c4 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 200 len: 1264 microversion: 2.1 time: 0.187421 Aug 31 12:35:46.450314 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 316/623] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:46 2022] GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 1264 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:46.948147 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-60b34cda-3855-42aa-a216-2a32c8092623 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:46.949523 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-60b34cda-3855-42aa-a216-2a32c8092623 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:46.956504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-60b34cda-3855-42aa-a216-2a32c8092623 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:46.956994 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-60b34cda-3855-42aa-a216-2a32c8092623 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:46.957432 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-60b34cda-3855-42aa-a216-2a32c8092623 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:46.958823 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-60b34cda-3855-42aa-a216-2a32c8092623 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:46.958823 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-60b34cda-3855-42aa-a216-2a32c8092623 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:46.959615 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-60b34cda-3855-42aa-a216-2a32c8092623 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:47.132930 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-60b34cda-3855-42aa-a216-2a32c8092623 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:47.141808 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-60b34cda-3855-42aa-a216-2a32c8092623 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:47.143187 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-60b34cda-3855-42aa-a216-2a32c8092623 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:47.144487 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-60b34cda-3855-42aa-a216-2a32c8092623 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1731 microversion: 2.20 time: 0.201655 Aug 31 12:35:47.145057 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 308/624] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:46 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1731 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:47.477190 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-442a2bef-92a1-4631-8622-e7858f75bf68 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:47.478150 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-442a2bef-92a1-4631-8622-e7858f75bf68 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:47.494141 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-442a2bef-92a1-4631-8622-e7858f75bf68 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:47.494628 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-442a2bef-92a1-4631-8622-e7858f75bf68 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:47.495221 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-442a2bef-92a1-4631-8622-e7858f75bf68 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:47.495808 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-442a2bef-92a1-4631-8622-e7858f75bf68 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:47.496263 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-442a2bef-92a1-4631-8622-e7858f75bf68 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:47.496683 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-442a2bef-92a1-4631-8622-e7858f75bf68 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:47.659911 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-442a2bef-92a1-4631-8622-e7858f75bf68 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:47.669234 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-442a2bef-92a1-4631-8622-e7858f75bf68 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 200 len: 1264 microversion: 2.1 time: 0.196441 Aug 31 12:35:47.678258 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 317/625] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:47 2022] GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 1264 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:48.168146 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-9fb7a545-d9a1-40a7-83ff-2b41261ab605 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:48.168735 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-9fb7a545-d9a1-40a7-83ff-2b41261ab605 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:48.175185 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9fb7a545-d9a1-40a7-83ff-2b41261ab605 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:48.175674 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9fb7a545-d9a1-40a7-83ff-2b41261ab605 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:48.176109 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9fb7a545-d9a1-40a7-83ff-2b41261ab605 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:48.176806 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9fb7a545-d9a1-40a7-83ff-2b41261ab605 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:48.177935 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9fb7a545-d9a1-40a7-83ff-2b41261ab605 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:48.178490 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9fb7a545-d9a1-40a7-83ff-2b41261ab605 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:48.201439 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:48.323992 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-9fb7a545-d9a1-40a7-83ff-2b41261ab605 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:48.332770 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-9fb7a545-d9a1-40a7-83ff-2b41261ab605 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:48.334981 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-9fb7a545-d9a1-40a7-83ff-2b41261ab605 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:48.336177 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-9fb7a545-d9a1-40a7-83ff-2b41261ab605 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1731 microversion: 2.20 time: 0.172080 Aug 31 12:35:48.336732 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 309/626] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:48 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:48.692113 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-c2bdaf9b-e35e-4b86-b181-8633f6dfee56 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:48.692728 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-c2bdaf9b-e35e-4b86-b181-8633f6dfee56 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:48.699319 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c2bdaf9b-e35e-4b86-b181-8633f6dfee56 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:48.699735 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c2bdaf9b-e35e-4b86-b181-8633f6dfee56 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:48.700163 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c2bdaf9b-e35e-4b86-b181-8633f6dfee56 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:48.700853 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c2bdaf9b-e35e-4b86-b181-8633f6dfee56 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:48.701309 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c2bdaf9b-e35e-4b86-b181-8633f6dfee56 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:48.701719 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c2bdaf9b-e35e-4b86-b181-8633f6dfee56 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:48.704424 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=91,nova_cell1:UPDATE=5 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:48.859393 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-c2bdaf9b-e35e-4b86-b181-8633f6dfee56 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:48.868449 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-c2bdaf9b-e35e-4b86-b181-8633f6dfee56 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 200 len: 1264 microversion: 2.1 time: 0.180238 Aug 31 12:35:48.869154 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 318/627] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:48 2022] GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:49.359396 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-0cdf028c-9640-4ee6-ab78-3f0c42156ace tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:49.360026 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-0cdf028c-9640-4ee6-ab78-3f0c42156ace tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:49.367423 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0cdf028c-9640-4ee6-ab78-3f0c42156ace tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:49.367908 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0cdf028c-9640-4ee6-ab78-3f0c42156ace tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:49.368340 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0cdf028c-9640-4ee6-ab78-3f0c42156ace tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:49.369028 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0cdf028c-9640-4ee6-ab78-3f0c42156ace tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:49.369475 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0cdf028c-9640-4ee6-ab78-3f0c42156ace tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:49.369895 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0cdf028c-9640-4ee6-ab78-3f0c42156ace tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:49.505257 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-0cdf028c-9640-4ee6-ab78-3f0c42156ace tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:49.514203 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-0cdf028c-9640-4ee6-ab78-3f0c42156ace tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:49.515669 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-0cdf028c-9640-4ee6-ab78-3f0c42156ace tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:49.516823 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-0cdf028c-9640-4ee6-ab78-3f0c42156ace tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1731 microversion: 2.20 time: 0.161497 Aug 31 12:35:49.517381 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 310/628] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:49 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:49.693523 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-c519e3a1-da51-4951-b293-c0821e0ffe74 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:49.694746 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-c519e3a1-da51-4951-b293-c0821e0ffe74 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:49.700558 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c519e3a1-da51-4951-b293-c0821e0ffe74 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:49.701043 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c519e3a1-da51-4951-b293-c0821e0ffe74 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:49.701473 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c519e3a1-da51-4951-b293-c0821e0ffe74 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:49.702164 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c519e3a1-da51-4951-b293-c0821e0ffe74 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:49.702614 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c519e3a1-da51-4951-b293-c0821e0ffe74 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:49.703067 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c519e3a1-da51-4951-b293-c0821e0ffe74 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:49.736845 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-c519e3a1-da51-4951-b293-c0821e0ffe74 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f/os-volume_attachments/159132ff-86a7-4aad-8fca-bee3653f91e3" status: 200 len: 194 microversion: 2.1 time: 0.047681 Aug 31 12:35:49.737716 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 319/629] 10.222.0.79 () {58 vars in 1413 bytes} [Wed Aug 31 12:35:49 2022] GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f/os-volume_attachments/159132ff-86a7-4aad-8fca-bee3653f91e3 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:35:49.748923 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-99437eec-2ed6-4e4d-9cf9-c0777b2ce81f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:49.749419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-99437eec-2ed6-4e4d-9cf9-c0777b2ce81f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:49.756205 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-99437eec-2ed6-4e4d-9cf9-c0777b2ce81f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:49.756802 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-99437eec-2ed6-4e4d-9cf9-c0777b2ce81f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:49.757192 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-99437eec-2ed6-4e4d-9cf9-c0777b2ce81f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:49.757887 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-99437eec-2ed6-4e4d-9cf9-c0777b2ce81f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:49.758333 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-99437eec-2ed6-4e4d-9cf9-c0777b2ce81f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:49.758752 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-99437eec-2ed6-4e4d-9cf9-c0777b2ce81f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:49.856509 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.objects.instance [None req-99437eec-2ed6-4e4d-9cf9-c0777b2ce81f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lazy-loading 'services' on Instance uuid 03c55128-ac55-4678-84c2-33c5ce3b426f {{(pid=120750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:35:49.889550 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-a169e2b5-8b55-44ad-9eb8-80ee3f111a3c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:49.890071 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-a169e2b5-8b55-44ad-9eb8-80ee3f111a3c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:49.896585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a169e2b5-8b55-44ad-9eb8-80ee3f111a3c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:49.897070 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a169e2b5-8b55-44ad-9eb8-80ee3f111a3c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:49.897691 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a169e2b5-8b55-44ad-9eb8-80ee3f111a3c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:49.898391 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a169e2b5-8b55-44ad-9eb8-80ee3f111a3c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:49.898844 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a169e2b5-8b55-44ad-9eb8-80ee3f111a3c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:49.899286 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a169e2b5-8b55-44ad-9eb8-80ee3f111a3c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:49.935733 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-99437eec-2ed6-4e4d-9cf9-c0777b2ce81f tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "DELETE /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f/os-volume_attachments/159132ff-86a7-4aad-8fca-bee3653f91e3" status: 202 len: 0 microversion: 2.1 time: 0.190601 Aug 31 12:35:49.936549 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 311/630] 10.222.0.79 () {58 vars in 1416 bytes} [Wed Aug 31 12:35:49 2022] DELETE /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f/os-volume_attachments/159132ff-86a7-4aad-8fca-bee3653f91e3 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:35:50.060108 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-a169e2b5-8b55-44ad-9eb8-80ee3f111a3c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:50.068208 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-a169e2b5-8b55-44ad-9eb8-80ee3f111a3c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 200 len: 1264 microversion: 2.1 time: 0.182380 Aug 31 12:35:50.069371 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 320/631] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:49 2022] GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 1264 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:50.542674 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-a55cc095-991a-4b4d-a2e8-e426e9b3342c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:50.543389 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-a55cc095-991a-4b4d-a2e8-e426e9b3342c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:50.549714 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a55cc095-991a-4b4d-a2e8-e426e9b3342c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:50.550292 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a55cc095-991a-4b4d-a2e8-e426e9b3342c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:50.550731 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a55cc095-991a-4b4d-a2e8-e426e9b3342c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:50.551452 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a55cc095-991a-4b4d-a2e8-e426e9b3342c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:50.551905 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a55cc095-991a-4b4d-a2e8-e426e9b3342c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:50.552430 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a55cc095-991a-4b4d-a2e8-e426e9b3342c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:50.761387 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-a55cc095-991a-4b4d-a2e8-e426e9b3342c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:50.770555 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-a55cc095-991a-4b4d-a2e8-e426e9b3342c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:50.772524 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-a55cc095-991a-4b4d-a2e8-e426e9b3342c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:50.773673 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-a55cc095-991a-4b4d-a2e8-e426e9b3342c tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1731 microversion: 2.20 time: 0.236928 Aug 31 12:35:50.774222 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 312/632] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:50 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1731 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:51.089642 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-1f4fbae3-ac9d-45ca-8317-f3c2d6ae1e8f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:51.090257 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-1f4fbae3-ac9d-45ca-8317-f3c2d6ae1e8f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:51.096768 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1f4fbae3-ac9d-45ca-8317-f3c2d6ae1e8f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:51.097288 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1f4fbae3-ac9d-45ca-8317-f3c2d6ae1e8f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:51.097723 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1f4fbae3-ac9d-45ca-8317-f3c2d6ae1e8f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:51.098416 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1f4fbae3-ac9d-45ca-8317-f3c2d6ae1e8f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:51.098907 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1f4fbae3-ac9d-45ca-8317-f3c2d6ae1e8f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:51.100077 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1f4fbae3-ac9d-45ca-8317-f3c2d6ae1e8f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:51.174372 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-89263359-9329-45d1-85b3-21fb1c8e0260 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:51.178672 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-89263359-9329-45d1-85b3-21fb1c8e0260 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:51.185694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-89263359-9329-45d1-85b3-21fb1c8e0260 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:51.186186 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-89263359-9329-45d1-85b3-21fb1c8e0260 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:51.186621 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-89263359-9329-45d1-85b3-21fb1c8e0260 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:51.187543 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-89263359-9329-45d1-85b3-21fb1c8e0260 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:51.188171 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-89263359-9329-45d1-85b3-21fb1c8e0260 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:51.188597 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-89263359-9329-45d1-85b3-21fb1c8e0260 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:51.220393 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-89263359-9329-45d1-85b3-21fb1c8e0260 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050194 Aug 31 12:35:51.220949 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 313/633] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 31 12:35:51 2022] GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 12:35:51.243445 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-1f4fbae3-ac9d-45ca-8317-f3c2d6ae1e8f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:51.253582 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-1f4fbae3-ac9d-45ca-8317-f3c2d6ae1e8f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 200 len: 1264 microversion: 2.1 time: 0.167325 Aug 31 12:35:51.254179 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 321/634] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:51 2022] GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:51.344115 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-e6e24186-4d04-4ad4-bc6d-09975844797e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:51.346266 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-e6e24186-4d04-4ad4-bc6d-09975844797e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:51.352571 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e6e24186-4d04-4ad4-bc6d-09975844797e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:51.353062 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e6e24186-4d04-4ad4-bc6d-09975844797e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:51.353553 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e6e24186-4d04-4ad4-bc6d-09975844797e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:51.354178 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e6e24186-4d04-4ad4-bc6d-09975844797e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:51.354688 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e6e24186-4d04-4ad4-bc6d-09975844797e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:51.355069 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e6e24186-4d04-4ad4-bc6d-09975844797e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:51.387854 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-e6e24186-4d04-4ad4-bc6d-09975844797e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047618 Aug 31 12:35:51.388752 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 314/635] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 31 12:35:51 2022] GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 12:35:51.457950 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-b628ae2b-c670-4495-80e8-238565326089 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:51.458332 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-b628ae2b-c670-4495-80e8-238565326089 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:51.464406 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b628ae2b-c670-4495-80e8-238565326089 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:51.464902 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b628ae2b-c670-4495-80e8-238565326089 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:51.465342 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b628ae2b-c670-4495-80e8-238565326089 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:51.466039 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b628ae2b-c670-4495-80e8-238565326089 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:51.466501 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b628ae2b-c670-4495-80e8-238565326089 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:51.466954 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b628ae2b-c670-4495-80e8-238565326089 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:51.492859 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-b628ae2b-c670-4495-80e8-238565326089 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Going to try to terminate instance {{(pid=120749) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:35:51.573257 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-b628ae2b-c670-4495-80e8-238565326089 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "DELETE /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f" status: 204 len: 0 microversion: 2.1 time: 0.118991 Aug 31 12:35:51.573855 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 322/636] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 31 12:35:51 2022] DELETE /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:35:51.582512 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-dac8e756-c379-4ffb-9db1-5c0e2745d691 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:51.583356 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-dac8e756-c379-4ffb-9db1-5c0e2745d691 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:51.590167 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dac8e756-c379-4ffb-9db1-5c0e2745d691 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:51.590342 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dac8e756-c379-4ffb-9db1-5c0e2745d691 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:51.590710 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dac8e756-c379-4ffb-9db1-5c0e2745d691 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:51.591465 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dac8e756-c379-4ffb-9db1-5c0e2745d691 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:51.591916 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dac8e756-c379-4ffb-9db1-5c0e2745d691 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:51.592331 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-dac8e756-c379-4ffb-9db1-5c0e2745d691 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:51.734625 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-dac8e756-c379-4ffb-9db1-5c0e2745d691 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:51.743948 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-dac8e756-c379-4ffb-9db1-5c0e2745d691 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f" status: 200 len: 1674 microversion: 2.1 time: 0.165788 Aug 31 12:35:51.744595 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 315/637] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:51 2022] GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:51.798064 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-78f09865-64b3-45a1-9503-bcae976d9f57 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:51.798752 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-78f09865-64b3-45a1-9503-bcae976d9f57 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:51.805299 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-78f09865-64b3-45a1-9503-bcae976d9f57 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:51.805784 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-78f09865-64b3-45a1-9503-bcae976d9f57 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:51.806211 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-78f09865-64b3-45a1-9503-bcae976d9f57 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:51.806936 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-78f09865-64b3-45a1-9503-bcae976d9f57 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:51.807510 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-78f09865-64b3-45a1-9503-bcae976d9f57 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:51.807865 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-78f09865-64b3-45a1-9503-bcae976d9f57 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:51.944897 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-78f09865-64b3-45a1-9503-bcae976d9f57 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:51.955943 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-78f09865-64b3-45a1-9503-bcae976d9f57 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:51.957377 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-78f09865-64b3-45a1-9503-bcae976d9f57 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:51.958580 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-78f09865-64b3-45a1-9503-bcae976d9f57 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1731 microversion: 2.20 time: 0.164757 Aug 31 12:35:51.959195 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 323/638] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:51 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:52.277301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-0507d89b-529a-4bb8-a196-173a390cc25b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:52.277910 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-0507d89b-529a-4bb8-a196-173a390cc25b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:52.283999 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0507d89b-529a-4bb8-a196-173a390cc25b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:52.284487 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0507d89b-529a-4bb8-a196-173a390cc25b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:52.284984 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0507d89b-529a-4bb8-a196-173a390cc25b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:52.285613 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0507d89b-529a-4bb8-a196-173a390cc25b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:52.286134 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0507d89b-529a-4bb8-a196-173a390cc25b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:52.286483 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0507d89b-529a-4bb8-a196-173a390cc25b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:52.423416 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-0507d89b-529a-4bb8-a196-173a390cc25b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:52.435992 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-0507d89b-529a-4bb8-a196-173a390cc25b tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 200 len: 1264 microversion: 2.1 time: 0.162555 Aug 31 12:35:52.436589 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 316/639] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:52 2022] GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:52.765256 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-8a00cf1b-552a-4aa7-acbb-0e94a08fba50 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:52.765851 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-8a00cf1b-552a-4aa7-acbb-0e94a08fba50 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:52.774100 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8a00cf1b-552a-4aa7-acbb-0e94a08fba50 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:52.774590 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8a00cf1b-552a-4aa7-acbb-0e94a08fba50 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:52.775064 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8a00cf1b-552a-4aa7-acbb-0e94a08fba50 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:52.775756 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8a00cf1b-552a-4aa7-acbb-0e94a08fba50 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:52.776211 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8a00cf1b-552a-4aa7-acbb-0e94a08fba50 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:52.776636 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8a00cf1b-552a-4aa7-acbb-0e94a08fba50 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:52.907621 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8a00cf1b-552a-4aa7-acbb-0e94a08fba50 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:52.915787 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-8a00cf1b-552a-4aa7-acbb-0e94a08fba50 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f" status: 200 len: 1674 microversion: 2.1 time: 0.154406 Aug 31 12:35:52.916349 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 324/640] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:52 2022] GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:52.981480 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-a8de7b89-b7a3-4949-af80-82d15c125937 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:52.982382 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-a8de7b89-b7a3-4949-af80-82d15c125937 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:52.989244 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a8de7b89-b7a3-4949-af80-82d15c125937 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:52.990447 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a8de7b89-b7a3-4949-af80-82d15c125937 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:52.991092 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a8de7b89-b7a3-4949-af80-82d15c125937 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:52.991884 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a8de7b89-b7a3-4949-af80-82d15c125937 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:52.992462 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a8de7b89-b7a3-4949-af80-82d15c125937 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:52.992941 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a8de7b89-b7a3-4949-af80-82d15c125937 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:53.128017 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-a8de7b89-b7a3-4949-af80-82d15c125937 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:53.136261 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-a8de7b89-b7a3-4949-af80-82d15c125937 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:53.137670 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-a8de7b89-b7a3-4949-af80-82d15c125937 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:53.138817 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-a8de7b89-b7a3-4949-af80-82d15c125937 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1731 microversion: 2.20 time: 0.161276 Aug 31 12:35:53.139402 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 317/641] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:52 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:53.457635 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-6dfab37a-f112-4a87-8933-f21262718495 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:53.458266 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-6dfab37a-f112-4a87-8933-f21262718495 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:53.464727 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6dfab37a-f112-4a87-8933-f21262718495 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:53.465213 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6dfab37a-f112-4a87-8933-f21262718495 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:53.465653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6dfab37a-f112-4a87-8933-f21262718495 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:53.466345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6dfab37a-f112-4a87-8933-f21262718495 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:53.466805 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6dfab37a-f112-4a87-8933-f21262718495 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:53.467257 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6dfab37a-f112-4a87-8933-f21262718495 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:53.621335 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-6dfab37a-f112-4a87-8933-f21262718495 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:53.629777 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-6dfab37a-f112-4a87-8933-f21262718495 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 200 len: 1264 microversion: 2.1 time: 0.175956 Aug 31 12:35:53.630412 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 325/642] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:53 2022] GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:53.736237 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-911f2156-5881-43fe-987f-824b58a7776d req-198175bf-1777-46d7-8c8e-d88fe1c43b97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bee1640-e8d5-48a7-b437-414aac42397a", "name": "network-vif-plugged", "status": "completed", "tag": "b673aa1b-a57f-46f1-bb92-bd62f55d451c"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:35:53.746952 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-911f2156-5881-43fe-987f-824b58a7776d req-198175bf-1777-46d7-8c8e-d88fe1c43b97 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:53.747538 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-911f2156-5881-43fe-987f-824b58a7776d req-198175bf-1777-46d7-8c8e-d88fe1c43b97 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:53.748051 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-911f2156-5881-43fe-987f-824b58a7776d req-198175bf-1777-46d7-8c8e-d88fe1c43b97 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:53.760651 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-911f2156-5881-43fe-987f-824b58a7776d req-198175bf-1777-46d7-8c8e-d88fe1c43b97 service nova] Creating event network-vif-plugged:b673aa1b-a57f-46f1-bb92-bd62f55d451c for instance 8bee1640-e8d5-48a7-b437-414aac42397a on hv-cinder-85528 Aug 31 12:35:53.766086 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-911f2156-5881-43fe-987f-824b58a7776d req-198175bf-1777-46d7-8c8e-d88fe1c43b97 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095710 Aug 31 12:35:53.767189 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 318/643] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:35:53.941833 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-279e2041-9e13-488d-9ea9-edbe700e613e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:53.943151 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-279e2041-9e13-488d-9ea9-edbe700e613e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:53.951404 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-279e2041-9e13-488d-9ea9-edbe700e613e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:53.952126 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-279e2041-9e13-488d-9ea9-edbe700e613e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:53.952829 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-279e2041-9e13-488d-9ea9-edbe700e613e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:53.953847 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-279e2041-9e13-488d-9ea9-edbe700e613e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:53.955010 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-279e2041-9e13-488d-9ea9-edbe700e613e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:53.955760 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-279e2041-9e13-488d-9ea9-edbe700e613e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:54.136190 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-279e2041-9e13-488d-9ea9-edbe700e613e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:54.145033 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-279e2041-9e13-488d-9ea9-edbe700e613e tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f" status: 200 len: 1674 microversion: 2.1 time: 0.210263 Aug 31 12:35:54.145621 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 326/644] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:53 2022] GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f => generated 1674 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:54.163823 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-41a8a72b-9902-4023-a796-6426729c88d2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:54.165043 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-41a8a72b-9902-4023-a796-6426729c88d2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:54.172096 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-41a8a72b-9902-4023-a796-6426729c88d2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:54.172616 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-41a8a72b-9902-4023-a796-6426729c88d2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:54.173075 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-41a8a72b-9902-4023-a796-6426729c88d2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:54.173769 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-41a8a72b-9902-4023-a796-6426729c88d2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:54.174276 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-41a8a72b-9902-4023-a796-6426729c88d2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:54.174878 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-41a8a72b-9902-4023-a796-6426729c88d2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:54.379468 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-41a8a72b-9902-4023-a796-6426729c88d2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:54.388544 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-41a8a72b-9902-4023-a796-6426729c88d2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:54.389971 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-41a8a72b-9902-4023-a796-6426729c88d2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:54.391156 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-41a8a72b-9902-4023-a796-6426729c88d2 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1731 microversion: 2.20 time: 0.232711 Aug 31 12:35:54.391720 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 319/645] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:54 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1731 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:54.499428 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-dc866c04-5eca-4cb6-b814-856e226e2a7b req-36f680e3-eac8-4037-8544-a0940dba953b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c55128-ac55-4678-84c2-33c5ce3b426f", "name": "network-vif-deleted", "tag": "551f8eda-257a-489c-852c-4480eabd8504"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:35:54.511764 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-dc866c04-5eca-4cb6-b814-856e226e2a7b req-36f680e3-eac8-4037-8544-a0940dba953b service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:54.512410 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-dc866c04-5eca-4cb6-b814-856e226e2a7b req-36f680e3-eac8-4037-8544-a0940dba953b service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:54.512905 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-dc866c04-5eca-4cb6-b814-856e226e2a7b req-36f680e3-eac8-4037-8544-a0940dba953b service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:54.527573 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-dc866c04-5eca-4cb6-b814-856e226e2a7b req-36f680e3-eac8-4037-8544-a0940dba953b service nova] Creating event network-vif-deleted:551f8eda-257a-489c-852c-4480eabd8504 for instance 03c55128-ac55-4678-84c2-33c5ce3b426f on hv-cinder-85528 Aug 31 12:35:54.533810 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-dc866c04-5eca-4cb6-b814-856e226e2a7b req-36f680e3-eac8-4037-8544-a0940dba953b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040160 Aug 31 12:35:54.534747 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 327/646] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:35:54.650894 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-cf0be2b3-596a-470b-a70a-2a6ff15cd21d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:54.651512 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-cf0be2b3-596a-470b-a70a-2a6ff15cd21d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:54.658398 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cf0be2b3-596a-470b-a70a-2a6ff15cd21d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:54.658911 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cf0be2b3-596a-470b-a70a-2a6ff15cd21d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:54.659357 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cf0be2b3-596a-470b-a70a-2a6ff15cd21d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:54.660069 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cf0be2b3-596a-470b-a70a-2a6ff15cd21d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:54.660525 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cf0be2b3-596a-470b-a70a-2a6ff15cd21d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:54.660950 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cf0be2b3-596a-470b-a70a-2a6ff15cd21d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:54.832130 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-cf0be2b3-596a-470b-a70a-2a6ff15cd21d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:54.843794 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-cf0be2b3-596a-470b-a70a-2a6ff15cd21d tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 200 len: 1264 microversion: 2.1 time: 0.197710 Aug 31 12:35:54.844375 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 320/647] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:54 2022] GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 1264 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:55.170533 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-f18b827e-063f-4b2a-ae1c-028542e62d45 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:55.171870 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-f18b827e-063f-4b2a-ae1c-028542e62d45 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:55.179133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f18b827e-063f-4b2a-ae1c-028542e62d45 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:55.179657 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f18b827e-063f-4b2a-ae1c-028542e62d45 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:55.180103 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f18b827e-063f-4b2a-ae1c-028542e62d45 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:55.180813 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f18b827e-063f-4b2a-ae1c-028542e62d45 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:55.181268 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f18b827e-063f-4b2a-ae1c-028542e62d45 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:55.181885 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f18b827e-063f-4b2a-ae1c-028542e62d45 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:55.215456 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f18b827e-063f-4b2a-ae1c-028542e62d45 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:55.215957 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f18b827e-063f-4b2a-ae1c-028542e62d45 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:55.216397 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f18b827e-063f-4b2a-ae1c-028542e62d45 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:55.216851 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.objects.instance [None req-f18b827e-063f-4b2a-ae1c-028542e62d45 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lazy-loading 'fault' on Instance uuid 03c55128-ac55-4678-84c2-33c5ce3b426f {{(pid=120749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:35:55.261068 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-f18b827e-063f-4b2a-ae1c-028542e62d45 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937aa5c23271467f83b05f570fde7468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1d7ad43ff24c31af3b53349b2063cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:55.269322 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-f18b827e-063f-4b2a-ae1c-028542e62d45 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f" status: 200 len: 1327 microversion: 2.1 time: 0.103383 Aug 31 12:35:55.269910 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 328/648] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:55 2022] GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f => generated 1327 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:55.415539 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-be0e5d28-7db7-46e0-b2ed-f870b649ea01 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:55.416219 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-be0e5d28-7db7-46e0-b2ed-f870b649ea01 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:55.422965 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-be0e5d28-7db7-46e0-b2ed-f870b649ea01 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:55.423460 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-be0e5d28-7db7-46e0-b2ed-f870b649ea01 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:55.423902 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-be0e5d28-7db7-46e0-b2ed-f870b649ea01 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:55.424598 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-be0e5d28-7db7-46e0-b2ed-f870b649ea01 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:55.425087 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-be0e5d28-7db7-46e0-b2ed-f870b649ea01 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:55.425513 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-be0e5d28-7db7-46e0-b2ed-f870b649ea01 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:55.584122 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-be0e5d28-7db7-46e0-b2ed-f870b649ea01 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:55.593638 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-be0e5d28-7db7-46e0-b2ed-f870b649ea01 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:55.595169 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-be0e5d28-7db7-46e0-b2ed-f870b649ea01 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:55.596335 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-be0e5d28-7db7-46e0-b2ed-f870b649ea01 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1731 microversion: 2.20 time: 0.186744 Aug 31 12:35:55.600191 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 321/649] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:55 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:55.866561 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-c6125aa9-8cb6-4dd0-b000-f1e81d8653fd tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:55.867848 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-c6125aa9-8cb6-4dd0-b000-f1e81d8653fd tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:55.877151 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c6125aa9-8cb6-4dd0-b000-f1e81d8653fd tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:55.878235 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c6125aa9-8cb6-4dd0-b000-f1e81d8653fd tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:55.879244 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c6125aa9-8cb6-4dd0-b000-f1e81d8653fd tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:55.881606 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c6125aa9-8cb6-4dd0-b000-f1e81d8653fd tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:55.882581 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c6125aa9-8cb6-4dd0-b000-f1e81d8653fd tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:55.883331 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c6125aa9-8cb6-4dd0-b000-f1e81d8653fd tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:55.899671 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-3ab5378a-0c33-4a00-b55d-50be224bf5d0 req-f09fbf9e-9b7a-4c10-967b-bc5f5ae3a73a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf8dc60e-6168-4d8a-b00a-56d3df39acc1", "name": "network-vif-plugged", "status": "completed", "tag": "5ee12b57-c6ee-4824-a0bc-c435d577bbdd"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:35:55.911070 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-3ab5378a-0c33-4a00-b55d-50be224bf5d0 req-f09fbf9e-9b7a-4c10-967b-bc5f5ae3a73a service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:55.911608 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-3ab5378a-0c33-4a00-b55d-50be224bf5d0 req-f09fbf9e-9b7a-4c10-967b-bc5f5ae3a73a service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:55.912037 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-3ab5378a-0c33-4a00-b55d-50be224bf5d0 req-f09fbf9e-9b7a-4c10-967b-bc5f5ae3a73a service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:55.923360 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-3ab5378a-0c33-4a00-b55d-50be224bf5d0 req-f09fbf9e-9b7a-4c10-967b-bc5f5ae3a73a service nova] Creating event network-vif-plugged:5ee12b57-c6ee-4824-a0bc-c435d577bbdd for instance bf8dc60e-6168-4d8a-b00a-56d3df39acc1 on hv-cinder-85528 Aug 31 12:35:55.928779 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-3ab5378a-0c33-4a00-b55d-50be224bf5d0 req-f09fbf9e-9b7a-4c10-967b-bc5f5ae3a73a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033373 Aug 31 12:35:55.929388 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 322/650] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:35:56.057653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-c6125aa9-8cb6-4dd0-b000-f1e81d8653fd tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:56.065337 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-c6125aa9-8cb6-4dd0-b000-f1e81d8653fd tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 200 len: 1264 microversion: 2.1 time: 0.203695 Aug 31 12:35:56.065892 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 329/651] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:55 2022] GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 1264 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:56.291641 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-0485ba32-3d71-445e-8052-16d39b4ecce0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:56.292354 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-0485ba32-3d71-445e-8052-16d39b4ecce0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:56.298566 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0485ba32-3d71-445e-8052-16d39b4ecce0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:56.299156 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0485ba32-3d71-445e-8052-16d39b4ecce0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:56.299594 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0485ba32-3d71-445e-8052-16d39b4ecce0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:56.300275 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0485ba32-3d71-445e-8052-16d39b4ecce0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:56.300718 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0485ba32-3d71-445e-8052-16d39b4ecce0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:56.301131 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0485ba32-3d71-445e-8052-16d39b4ecce0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:56.314151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-0485ba32-3d71-445e-8052-16d39b4ecce0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] HTTP exception thrown: Instance 03c55128-ac55-4678-84c2-33c5ce3b426f could not be found. Aug 31 12:35:56.315708 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-0485ba32-3d71-445e-8052-16d39b4ecce0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Request method failure captured: Aug 31 12:35:56.315708 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f HTTP/1.1 Aug 31 12:35:56.315708 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:35:56.315708 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:35:56.315708 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:35:56.315708 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 0 Aug 31 12:35:56.315708 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:35:56.315708 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:35:56.315708 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:35:56.315708 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:35:56.315708 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1Q7v2mO-kd2scOxrG2E8M4nJrqoBKWSkTSI_tfXxHhy7YcIFS2CjLmlIbaT1cJhcU7z1zHp5GfIvWGnI09hIRjHbV9JsC3gZspw702ajUi9P1zq1xok55mpWIQYvGj6EfBDzfBlBMvuenNv6umQC-syhiXVaer2KK3wMNcGEicqoR8 Aug 31 12:35:56.315708 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:35:56.315708 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:35:56.315708 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:35:56.315708 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:35:56.315708 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:35:56.315708 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:35:56.315708 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: 0b1d7ad43ff24c31af3b53349b2063cd Aug 31 12:35:56.315708 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-AttachVolumeTestJSON-634442655 Aug 31 12:35:56.315708 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:35:56.315708 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:35:56.318499 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0b1d7ad43ff24c31af3b53349b2063cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0b1d7ad43ff24c31af3b53349b2063cd", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b1d7ad43ff24c31af3b53349b2063cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b1d7ad43ff24c31af3b53349b2063cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:35:56.318499 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-AttachVolumeTestJSON-634442655 Aug 31 12:35:56.318499 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: 0b1d7ad43ff24c31af3b53349b2063cd Aug 31 12:35:56.318499 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-AttachVolumeTestJSON-634442655 Aug 31 12:35:56.318499 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-AttachVolumeTestJSON-634442655-project Aug 31 12:35:56.318499 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:35:56.318499 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:35:56.318499 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: 937aa5c23271467f83b05f570fde7468 Aug 31 12:35:56.318499 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-AttachVolumeTestJSON-634442655-project Aug 31 12:35:56.318499 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:35:56.318499 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Instance 03c55128-ac55-4678-84c2-33c5ce3b426f could not be found. Aug 31 12:35:56.318499 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'id': '03c55128-ac55-4678-84c2-33c5ce3b426f'} Aug 31 12:35:56.319913 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:35:56.319913 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:35:56.319913 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:35:56.319913 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:35:56.319913 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:35:56.319913 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:35:56.319913 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:35:56.319913 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:35:56.319913 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:35:56.319913 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:35:56.319913 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03c55128-ac55-4678-84c2-33c5ce3b426f could not be found. Aug 31 12:35:56.319913 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:35:56.319913 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:35:56.319913 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:35:56.319913 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:35:56.319913 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:35:56.319913 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:35:56.319913 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:35:56.319913 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:35:56.319913 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:35:56.322299 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:35:56.322299 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:35:56.322299 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:35:56.322299 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:35:56.322299 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:35:56.322299 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:35:56.322299 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:35:56.322299 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03c55128-ac55-4678-84c2-33c5ce3b426f could not be found. Aug 31 12:35:56.322299 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:35:56.322299 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:35:56.322299 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:35:56.322299 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:35:56.322299 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:35:56.322299 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:35:56.322299 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:35:56.322299 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:35:56.322299 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03c55128-ac55-4678-84c2-33c5ce3b426f could not be found. Aug 31 12:35:56.322299 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:35:56.324407 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-0485ba32-3d71-445e-8052-16d39b4ecce0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Returning 404 to user: Instance 03c55128-ac55-4678-84c2-33c5ce3b426f could not be found. {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:35:56.324407 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-0485ba32-3d71-445e-8052-16d39b4ecce0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f" status: 404 len: 111 microversion: 2.1 time: 0.029661 Aug 31 12:35:56.324407 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 323/652] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:56 2022] GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:35:56.326966 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-a87f3bba-5e9a-4faa-991d-6f966a2347f0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '.version_select at 0x7f8d16f801f0>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:56.346311 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-a87f3bba-5e9a-4faa-991d-6f966a2347f0 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1453084084" status: 202 len: 0 microversion: 2.1 time: 0.023008 Aug 31 12:35:56.346906 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 330/653] 10.222.0.79 () {58 vars in 1221 bytes} [Wed Aug 31 12:35:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1453084084 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:35:56.624452 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-8ac3a156-d2a3-431e-8c4a-ec3d7e6ca5a4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:56.625057 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-8ac3a156-d2a3-431e-8c4a-ec3d7e6ca5a4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:56.633626 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8ac3a156-d2a3-431e-8c4a-ec3d7e6ca5a4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:56.633626 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8ac3a156-d2a3-431e-8c4a-ec3d7e6ca5a4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:56.634104 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8ac3a156-d2a3-431e-8c4a-ec3d7e6ca5a4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:56.634502 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8ac3a156-d2a3-431e-8c4a-ec3d7e6ca5a4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:56.634967 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8ac3a156-d2a3-431e-8c4a-ec3d7e6ca5a4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:56.635450 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8ac3a156-d2a3-431e-8c4a-ec3d7e6ca5a4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:56.798213 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-8ac3a156-d2a3-431e-8c4a-ec3d7e6ca5a4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:56.807522 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-8ac3a156-d2a3-431e-8c4a-ec3d7e6ca5a4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:56.808986 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-8ac3a156-d2a3-431e-8c4a-ec3d7e6ca5a4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:56.810191 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-8ac3a156-d2a3-431e-8c4a-ec3d7e6ca5a4 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1718 microversion: 2.20 time: 0.189689 Aug 31 12:35:56.810751 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 324/654] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:56 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1718 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:57.090216 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-4eb12ff7-e489-4025-a42f-d798495fc989 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:57.091504 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-4eb12ff7-e489-4025-a42f-d798495fc989 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:57.106137 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4eb12ff7-e489-4025-a42f-d798495fc989 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:57.107089 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4eb12ff7-e489-4025-a42f-d798495fc989 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:57.107884 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4eb12ff7-e489-4025-a42f-d798495fc989 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:57.109151 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4eb12ff7-e489-4025-a42f-d798495fc989 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:57.109981 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4eb12ff7-e489-4025-a42f-d798495fc989 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:57.110732 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4eb12ff7-e489-4025-a42f-d798495fc989 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:57.261446 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-4eb12ff7-e489-4025-a42f-d798495fc989 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:57.269296 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-4eb12ff7-e489-4025-a42f-d798495fc989 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 200 len: 1264 microversion: 2.1 time: 0.187394 Aug 31 12:35:57.269920 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 331/655] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:57 2022] GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 1264 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:58.290789 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-a1353161-dae6-4bdd-b718-534b0c74e949 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:58.291446 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-a1353161-dae6-4bdd-b718-534b0c74e949 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:58.297963 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a1353161-dae6-4bdd-b718-534b0c74e949 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:58.298446 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a1353161-dae6-4bdd-b718-534b0c74e949 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:58.298892 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a1353161-dae6-4bdd-b718-534b0c74e949 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:58.299594 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a1353161-dae6-4bdd-b718-534b0c74e949 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:58.300027 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a1353161-dae6-4bdd-b718-534b0c74e949 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:58.300437 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a1353161-dae6-4bdd-b718-534b0c74e949 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:58.439955 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-a1353161-dae6-4bdd-b718-534b0c74e949 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:58.449558 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-a1353161-dae6-4bdd-b718-534b0c74e949 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 200 len: 1451 microversion: 2.1 time: 0.163353 Aug 31 12:35:58.450545 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 325/656] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:58 2022] GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 1451 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:58.471034 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-e3b302d5-142d-4a11-a3bd-458ddeca2a05 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:58.471651 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-e3b302d5-142d-4a11-a3bd-458ddeca2a05 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:58.476054 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:58.480280 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e3b302d5-142d-4a11-a3bd-458ddeca2a05 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:58.480852 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e3b302d5-142d-4a11-a3bd-458ddeca2a05 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:58.481293 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e3b302d5-142d-4a11-a3bd-458ddeca2a05 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:58.482175 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e3b302d5-142d-4a11-a3bd-458ddeca2a05 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:58.482771 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e3b302d5-142d-4a11-a3bd-458ddeca2a05 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:58.483331 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e3b302d5-142d-4a11-a3bd-458ddeca2a05 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:58.622358 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-e3b302d5-142d-4a11-a3bd-458ddeca2a05 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:58.630407 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-e3b302d5-142d-4a11-a3bd-458ddeca2a05 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 200 len: 1451 microversion: 2.1 time: 0.163247 Aug 31 12:35:58.631145 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 332/657] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:58 2022] GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 1451 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:59.296821 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-3639d087-3c14-4b7d-a206-9face89bab51 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:59.297330 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-3639d087-3c14-4b7d-a206-9face89bab51 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:59.299708 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_api:SELECT=74 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:59.305175 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3639d087-3c14-4b7d-a206-9face89bab51 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:59.305759 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3639d087-3c14-4b7d-a206-9face89bab51 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:59.306078 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3639d087-3c14-4b7d-a206-9face89bab51 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:59.306764 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3639d087-3c14-4b7d-a206-9face89bab51 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:59.307242 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3639d087-3c14-4b7d-a206-9face89bab51 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:59.307857 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3639d087-3c14-4b7d-a206-9face89bab51 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:59.323388 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-3639d087-3c14-4b7d-a206-9face89bab51 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] HTTP exception thrown: Instance 03c55128-ac55-4678-84c2-33c5ce3b426f could not be found. Aug 31 12:35:59.325324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-3639d087-3c14-4b7d-a206-9face89bab51 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Request method failure captured: Aug 31 12:35:59.325324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: DELETE /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f HTTP/1.1 Aug 31 12:35:59.325324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:35:59.325324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:35:59.325324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:35:59.325324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 0 Aug 31 12:35:59.325324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:35:59.325324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:35:59.325324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:35:59.325324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:35:59.325324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1Q7v2mO-kd2scOxrG2E8M4nJrqoBKWSkTSI_tfXxHhy7YcIFS2CjLmlIbaT1cJhcU7z1zHp5GfIvWGnI09hIRjHbV9JsC3gZspw702ajUi9P1zq1xok55mpWIQYvGj6EfBDzfBlBMvuenNv6umQC-syhiXVaer2KK3wMNcGEicqoR8 Aug 31 12:35:59.325324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:35:59.325324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:35:59.325324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:35:59.325324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:35:59.325324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:35:59.325324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:35:59.325324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: 0b1d7ad43ff24c31af3b53349b2063cd Aug 31 12:35:59.325324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-AttachVolumeTestJSON-634442655 Aug 31 12:35:59.325324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:35:59.325324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:35:59.326646 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0b1d7ad43ff24c31af3b53349b2063cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0b1d7ad43ff24c31af3b53349b2063cd", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b1d7ad43ff24c31af3b53349b2063cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b1d7ad43ff24c31af3b53349b2063cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:35:59.326646 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-AttachVolumeTestJSON-634442655 Aug 31 12:35:59.326646 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: 0b1d7ad43ff24c31af3b53349b2063cd Aug 31 12:35:59.326646 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-AttachVolumeTestJSON-634442655 Aug 31 12:35:59.326646 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-AttachVolumeTestJSON-634442655-project Aug 31 12:35:59.326646 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:35:59.326646 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:35:59.326646 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: 937aa5c23271467f83b05f570fde7468 Aug 31 12:35:59.326646 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-AttachVolumeTestJSON-634442655-project Aug 31 12:35:59.326646 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:35:59.326646 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Instance 03c55128-ac55-4678-84c2-33c5ce3b426f could not be found. Aug 31 12:35:59.326646 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'id': '03c55128-ac55-4678-84c2-33c5ce3b426f'} Aug 31 12:35:59.327450 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:35:59.327450 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:35:59.327450 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:35:59.327450 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:35:59.327450 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:35:59.327450 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:35:59.327450 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:35:59.327450 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:35:59.327450 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:35:59.327450 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:35:59.327450 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03c55128-ac55-4678-84c2-33c5ce3b426f could not be found. Aug 31 12:35:59.327450 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:35:59.327450 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:35:59.327450 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:35:59.327450 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:35:59.327450 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:35:59.327450 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:35:59.327450 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:35:59.327450 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:35:59.327450 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:35:59.328631 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:35:59.328631 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 12:35:59.328631 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 12:35:59.328631 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 12:35:59.328631 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 12:35:59.328631 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:35:59.328631 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:35:59.328631 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:35:59.328631 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:35:59.328631 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03c55128-ac55-4678-84c2-33c5ce3b426f could not be found. Aug 31 12:35:59.328631 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:35:59.328631 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:35:59.328631 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:35:59.328631 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:35:59.328631 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:35:59.328631 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:35:59.328631 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:35:59.328631 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:35:59.328631 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03c55128-ac55-4678-84c2-33c5ce3b426f could not be found. Aug 31 12:35:59.328631 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:35:59.329875 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-3639d087-3c14-4b7d-a206-9face89bab51 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Returning 404 to user: Instance 03c55128-ac55-4678-84c2-33c5ce3b426f could not be found. {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:35:59.329875 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-3639d087-3c14-4b7d-a206-9face89bab51 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "DELETE /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f" status: 404 len: 111 microversion: 2.1 time: 0.033922 Aug 31 12:35:59.329875 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 326/658] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 31 12:35:59 2022] DELETE /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:35:59.336261 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-a91c442c-82c0-4e3e-812a-e6ee3a786a9d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:59.336878 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-a91c442c-82c0-4e3e-812a-e6ee3a786a9d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 03c55128-ac55-4678-84c2-33c5ce3b426f] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:59.342779 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a91c442c-82c0-4e3e-812a-e6ee3a786a9d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:59.343322 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a91c442c-82c0-4e3e-812a-e6ee3a786a9d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:59.343767 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a91c442c-82c0-4e3e-812a-e6ee3a786a9d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:59.344467 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a91c442c-82c0-4e3e-812a-e6ee3a786a9d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:59.344955 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a91c442c-82c0-4e3e-812a-e6ee3a786a9d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:59.345383 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a91c442c-82c0-4e3e-812a-e6ee3a786a9d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:59.362311 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.wsgi [None req-a91c442c-82c0-4e3e-812a-e6ee3a786a9d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] HTTP exception thrown: Instance 03c55128-ac55-4678-84c2-33c5ce3b426f could not be found. Aug 31 12:35:59.364369 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-a91c442c-82c0-4e3e-812a-e6ee3a786a9d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Request method failure captured: Aug 31 12:35:59.364369 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: request: GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f HTTP/1.1 Aug 31 12:35:59.364369 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept: application/json Aug 31 12:35:59.364369 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept-Encoding: identity Aug 31 12:35:59.364369 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Connection: close Aug 31 12:35:59.364369 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Length: 0 Aug 31 12:35:59.364369 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Type: application/json Aug 31 12:35:59.364369 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Host: 10.222.0.79 Aug 31 12:35:59.364369 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Openstack-System-Scope: None Aug 31 12:35:59.364369 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: User-Agent: python-urllib3/1.26.12 Aug 31 12:35:59.364369 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Auth-Token: gAAAAABjD1Q7v2mO-kd2scOxrG2E8M4nJrqoBKWSkTSI_tfXxHhy7YcIFS2CjLmlIbaT1cJhcU7z1zHp5GfIvWGnI09hIRjHbV9JsC3gZspw702ajUi9P1zq1xok55mpWIQYvGj6EfBDzfBlBMvuenNv6umQC-syhiXVaer2KK3wMNcGEicqoR8 Aug 31 12:35:59.364369 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Id: None Aug 31 12:35:59.364369 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Name: None Aug 31 12:35:59.364369 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Identity-Status: Confirmed Aug 31 12:35:59.364369 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Is-Admin-Project: True Aug 31 12:35:59.364369 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Id: default Aug 31 12:35:59.364369 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Name: Default Aug 31 12:35:59.364369 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Id: 0b1d7ad43ff24c31af3b53349b2063cd Aug 31 12:35:59.364369 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Name: tempest-AttachVolumeTestJSON-634442655 Aug 31 12:35:59.364369 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Role: reader,member Aug 31 12:35:59.364369 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Roles: reader,member Aug 31 12:35:59.366133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0b1d7ad43ff24c31af3b53349b2063cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0b1d7ad43ff24c31af3b53349b2063cd", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b1d7ad43ff24c31af3b53349b2063cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b1d7ad43ff24c31af3b53349b2063cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:35:59.366133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant: tempest-AttachVolumeTestJSON-634442655 Aug 31 12:35:59.366133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Id: 0b1d7ad43ff24c31af3b53349b2063cd Aug 31 12:35:59.366133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Name: tempest-AttachVolumeTestJSON-634442655 Aug 31 12:35:59.366133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User: tempest-AttachVolumeTestJSON-634442655-project Aug 31 12:35:59.366133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Id: default Aug 31 12:35:59.366133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Name: Default Aug 31 12:35:59.366133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Id: 937aa5c23271467f83b05f570fde7468 Aug 31 12:35:59.366133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Name: tempest-AttachVolumeTestJSON-634442655-project Aug 31 12:35:59.366133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: method: > Aug 31 12:35:59.366133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: exception: Instance 03c55128-ac55-4678-84c2-33c5ce3b426f could not be found. Aug 31 12:35:59.366133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: action_args: {'id': '03c55128-ac55-4678-84c2-33c5ce3b426f'} Aug 31 12:35:59.366929 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:35:59.366929 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:35:59.366929 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:35:59.366929 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:35:59.366929 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:35:59.366929 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:35:59.366929 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:35:59.366929 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:35:59.366929 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:35:59.366929 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:35:59.366929 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03c55128-ac55-4678-84c2-33c5ce3b426f could not be found. Aug 31 12:35:59.366929 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:35:59.366929 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:35:59.366929 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:35:59.366929 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:35:59.366929 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:35:59.366929 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:35:59.366929 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:35:59.366929 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:35:59.366929 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:35:59.368163 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:35:59.368163 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:35:59.368163 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:35:59.368163 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:35:59.368163 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:35:59.368163 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:35:59.368163 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:35:59.368163 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03c55128-ac55-4678-84c2-33c5ce3b426f could not be found. Aug 31 12:35:59.368163 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:35:59.368163 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:35:59.368163 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:35:59.368163 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:35:59.368163 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:35:59.368163 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:35:59.368163 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:35:59.368163 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:35:59.368163 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03c55128-ac55-4678-84c2-33c5ce3b426f could not be found. Aug 31 12:35:59.368163 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:35:59.369253 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-a91c442c-82c0-4e3e-812a-e6ee3a786a9d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Returning 404 to user: Instance 03c55128-ac55-4678-84c2-33c5ce3b426f could not be found. {{(pid=120749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:35:59.369253 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-a91c442c-82c0-4e3e-812a-e6ee3a786a9d tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f" status: 404 len: 111 microversion: 2.1 time: 0.034421 Aug 31 12:35:59.369253 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 333/659] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:59 2022] GET /compute/v2.1/servers/03c55128-ac55-4678-84c2-33c5ce3b426f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:36:00.522159 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-e64ddbda-413a-4c61-8e0b-0d75a2d882d8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:00.522883 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-f59e0794-2c02-48f2-939c-ce3ad32fd111 req-00107a10-4693-4a71-8828-d95105b924d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf8dc60e-6168-4d8a-b00a-56d3df39acc1", "tag": "5ee12b57-c6ee-4824-a0bc-c435d577bbdd"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:36:00.523870 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-e64ddbda-413a-4c61-8e0b-0d75a2d882d8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:00.530503 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e64ddbda-413a-4c61-8e0b-0d75a2d882d8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:00.531028 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e64ddbda-413a-4c61-8e0b-0d75a2d882d8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:00.531462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e64ddbda-413a-4c61-8e0b-0d75a2d882d8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:00.532009 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-f59e0794-2c02-48f2-939c-ce3ad32fd111 req-00107a10-4693-4a71-8828-d95105b924d7 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:00.532159 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e64ddbda-413a-4c61-8e0b-0d75a2d882d8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:00.532610 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e64ddbda-413a-4c61-8e0b-0d75a2d882d8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:00.532815 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-f59e0794-2c02-48f2-939c-ce3ad32fd111 req-00107a10-4693-4a71-8828-d95105b924d7 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:00.533033 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e64ddbda-413a-4c61-8e0b-0d75a2d882d8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:00.533205 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-f59e0794-2c02-48f2-939c-ce3ad32fd111 req-00107a10-4693-4a71-8828-d95105b924d7 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:00.546516 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-f59e0794-2c02-48f2-939c-ce3ad32fd111 req-00107a10-4693-4a71-8828-d95105b924d7 service nova] Creating event network-changed:5ee12b57-c6ee-4824-a0bc-c435d577bbdd for instance bf8dc60e-6168-4d8a-b00a-56d3df39acc1 on hv-cinder-85528 Aug 31 12:36:00.548110 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.wsgi [None req-e64ddbda-413a-4c61-8e0b-0d75a2d882d8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] HTTP exception thrown: Instance 59de5135-bc13-4ecc-a3b9-015b32aec285 could not be found. Aug 31 12:36:00.550966 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-e64ddbda-413a-4c61-8e0b-0d75a2d882d8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Request method failure captured: Aug 31 12:36:00.550966 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: request: DELETE /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 HTTP/1.1 Aug 31 12:36:00.550966 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept: application/json Aug 31 12:36:00.550966 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept-Encoding: identity Aug 31 12:36:00.550966 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Connection: close Aug 31 12:36:00.550966 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Length: 0 Aug 31 12:36:00.550966 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Type: application/json Aug 31 12:36:00.550966 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Host: 10.222.0.79 Aug 31 12:36:00.550966 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Openstack-System-Scope: None Aug 31 12:36:00.550966 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: User-Agent: python-urllib3/1.26.12 Aug 31 12:36:00.550966 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Auth-Token: gAAAAABjD1Q7v2mO-kd2scOxrG2E8M4nJrqoBKWSkTSI_tfXxHhy7YcIFS2CjLmlIbaT1cJhcU7z1zHp5GfIvWGnI09hIRjHbV9JsC3gZspw702ajUi9P1zq1xok55mpWIQYvGj6EfBDzfBlBMvuenNv6umQC-syhiXVaer2KK3wMNcGEicqoR8 Aug 31 12:36:00.550966 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Id: None Aug 31 12:36:00.550966 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Name: None Aug 31 12:36:00.550966 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Identity-Status: Confirmed Aug 31 12:36:00.550966 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Is-Admin-Project: True Aug 31 12:36:00.550966 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Id: default Aug 31 12:36:00.550966 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Name: Default Aug 31 12:36:00.550966 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Id: 0b1d7ad43ff24c31af3b53349b2063cd Aug 31 12:36:00.550966 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Name: tempest-AttachVolumeTestJSON-634442655 Aug 31 12:36:00.550966 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Role: reader,member Aug 31 12:36:00.550966 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Roles: reader,member Aug 31 12:36:00.552422 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0b1d7ad43ff24c31af3b53349b2063cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0b1d7ad43ff24c31af3b53349b2063cd", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b1d7ad43ff24c31af3b53349b2063cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b1d7ad43ff24c31af3b53349b2063cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:36:00.552422 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant: tempest-AttachVolumeTestJSON-634442655 Aug 31 12:36:00.552422 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Id: 0b1d7ad43ff24c31af3b53349b2063cd Aug 31 12:36:00.552422 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Name: tempest-AttachVolumeTestJSON-634442655 Aug 31 12:36:00.552422 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User: tempest-AttachVolumeTestJSON-634442655-project Aug 31 12:36:00.552422 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Id: default Aug 31 12:36:00.552422 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Name: Default Aug 31 12:36:00.552422 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Id: 937aa5c23271467f83b05f570fde7468 Aug 31 12:36:00.552422 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Name: tempest-AttachVolumeTestJSON-634442655-project Aug 31 12:36:00.552422 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: method: > Aug 31 12:36:00.552422 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: exception: Instance 59de5135-bc13-4ecc-a3b9-015b32aec285 could not be found. Aug 31 12:36:00.552422 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: action_args: {'id': '59de5135-bc13-4ecc-a3b9-015b32aec285'} Aug 31 12:36:00.554328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:36:00.554328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:36:00.554328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:36:00.554328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:36:00.554328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:36:00.554328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:36:00.554328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:36:00.554328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:36:00.554328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:36:00.554328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:36:00.554328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59de5135-bc13-4ecc-a3b9-015b32aec285 could not be found. Aug 31 12:36:00.554328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:36:00.554328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:36:00.554328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:36:00.554328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:36:00.554328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:36:00.554328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:36:00.554328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:36:00.554328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:36:00.554328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:36:00.556055 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:36:00.556055 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 12:36:00.556055 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 12:36:00.556055 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 12:36:00.556055 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 12:36:00.556055 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:36:00.556055 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:36:00.556055 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:36:00.556055 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:36:00.556055 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59de5135-bc13-4ecc-a3b9-015b32aec285 could not be found. Aug 31 12:36:00.556055 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:36:00.556055 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:36:00.556055 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:36:00.556055 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:36:00.556055 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:36:00.556055 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:36:00.556055 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:36:00.556055 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:36:00.556055 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59de5135-bc13-4ecc-a3b9-015b32aec285 could not be found. Aug 31 12:36:00.556055 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:36:00.557988 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-f59e0794-2c02-48f2-939c-ce3ad32fd111 req-00107a10-4693-4a71-8828-d95105b924d7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033313 Aug 31 12:36:00.558403 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-e64ddbda-413a-4c61-8e0b-0d75a2d882d8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Returning 404 to user: Instance 59de5135-bc13-4ecc-a3b9-015b32aec285 could not be found. {{(pid=120749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:36:00.558403 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-e64ddbda-413a-4c61-8e0b-0d75a2d882d8 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "DELETE /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 404 len: 111 microversion: 2.1 time: 0.034716 Aug 31 12:36:00.558586 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 327/660] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:36:00.558782 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 334/661] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 31 12:36:00 2022] DELETE /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:36:00.564625 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-e39b9b4a-67d2-4abf-9d3d-83f4b37474c5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:00.565326 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-e39b9b4a-67d2-4abf-9d3d-83f4b37474c5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] [instance: 59de5135-bc13-4ecc-a3b9-015b32aec285] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:00.572896 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e39b9b4a-67d2-4abf-9d3d-83f4b37474c5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:00.573429 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e39b9b4a-67d2-4abf-9d3d-83f4b37474c5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:00.574061 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e39b9b4a-67d2-4abf-9d3d-83f4b37474c5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:00.574780 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e39b9b4a-67d2-4abf-9d3d-83f4b37474c5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:00.575324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e39b9b4a-67d2-4abf-9d3d-83f4b37474c5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:00.575729 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e39b9b4a-67d2-4abf-9d3d-83f4b37474c5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:00.591807 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-e39b9b4a-67d2-4abf-9d3d-83f4b37474c5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] HTTP exception thrown: Instance 59de5135-bc13-4ecc-a3b9-015b32aec285 could not be found. Aug 31 12:36:00.593652 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-e39b9b4a-67d2-4abf-9d3d-83f4b37474c5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Request method failure captured: Aug 31 12:36:00.593652 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 HTTP/1.1 Aug 31 12:36:00.593652 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:36:00.593652 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:36:00.593652 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:36:00.593652 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 0 Aug 31 12:36:00.593652 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:36:00.593652 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:36:00.593652 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:36:00.593652 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:36:00.593652 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1Q7v2mO-kd2scOxrG2E8M4nJrqoBKWSkTSI_tfXxHhy7YcIFS2CjLmlIbaT1cJhcU7z1zHp5GfIvWGnI09hIRjHbV9JsC3gZspw702ajUi9P1zq1xok55mpWIQYvGj6EfBDzfBlBMvuenNv6umQC-syhiXVaer2KK3wMNcGEicqoR8 Aug 31 12:36:00.593652 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:36:00.593652 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:36:00.593652 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:36:00.593652 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:36:00.593652 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:36:00.593652 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:36:00.593652 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: 0b1d7ad43ff24c31af3b53349b2063cd Aug 31 12:36:00.593652 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-AttachVolumeTestJSON-634442655 Aug 31 12:36:00.593652 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:36:00.593652 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:36:00.595290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0b1d7ad43ff24c31af3b53349b2063cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0b1d7ad43ff24c31af3b53349b2063cd", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b1d7ad43ff24c31af3b53349b2063cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b1d7ad43ff24c31af3b53349b2063cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:36:00.595290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-AttachVolumeTestJSON-634442655 Aug 31 12:36:00.595290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: 0b1d7ad43ff24c31af3b53349b2063cd Aug 31 12:36:00.595290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-AttachVolumeTestJSON-634442655 Aug 31 12:36:00.595290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-AttachVolumeTestJSON-634442655-project Aug 31 12:36:00.595290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:36:00.595290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:36:00.595290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: 937aa5c23271467f83b05f570fde7468 Aug 31 12:36:00.595290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-AttachVolumeTestJSON-634442655-project Aug 31 12:36:00.595290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:36:00.595290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Instance 59de5135-bc13-4ecc-a3b9-015b32aec285 could not be found. Aug 31 12:36:00.595290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'id': '59de5135-bc13-4ecc-a3b9-015b32aec285'} Aug 31 12:36:00.596185 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:36:00.596185 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:36:00.596185 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:36:00.596185 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:36:00.596185 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:36:00.596185 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:36:00.596185 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:36:00.596185 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:36:00.596185 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:36:00.596185 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:36:00.596185 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59de5135-bc13-4ecc-a3b9-015b32aec285 could not be found. Aug 31 12:36:00.596185 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:36:00.596185 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:36:00.596185 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:36:00.596185 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:36:00.596185 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:36:00.596185 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:36:00.596185 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:36:00.596185 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:36:00.596185 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:36:00.597703 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:36:00.597703 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:36:00.597703 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:36:00.597703 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:36:00.597703 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:36:00.597703 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:36:00.597703 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:36:00.597703 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59de5135-bc13-4ecc-a3b9-015b32aec285 could not be found. Aug 31 12:36:00.597703 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:36:00.597703 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:36:00.597703 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:36:00.597703 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:36:00.597703 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:36:00.597703 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:36:00.597703 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:36:00.597703 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:36:00.597703 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59de5135-bc13-4ecc-a3b9-015b32aec285 could not be found. Aug 31 12:36:00.597703 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:36:00.599024 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-e39b9b4a-67d2-4abf-9d3d-83f4b37474c5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] Returning 404 to user: Instance 59de5135-bc13-4ecc-a3b9-015b32aec285 could not be found. {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:36:00.599024 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-e39b9b4a-67d2-4abf-9d3d-83f4b37474c5 tempest-AttachVolumeTestJSON-634442655 tempest-AttachVolumeTestJSON-634442655-project] 10.222.0.79 "GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285" status: 404 len: 111 microversion: 2.1 time: 0.037278 Aug 31 12:36:00.599549 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 328/662] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:00 2022] GET /compute/v2.1/servers/59de5135-bc13-4ecc-a3b9-015b32aec285 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:36:05.337485 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-efdde00c-fd9d-40e2-9a30-0022637f0a83 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:05.338009 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-efdde00c-fd9d-40e2-9a30-0022637f0a83 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d921f6f0-2017-4941-8d52-1abe875c6ebe] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:05.345854 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-efdde00c-fd9d-40e2-9a30-0022637f0a83 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:05.346346 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-efdde00c-fd9d-40e2-9a30-0022637f0a83 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:05.346790 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-efdde00c-fd9d-40e2-9a30-0022637f0a83 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:05.347513 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-efdde00c-fd9d-40e2-9a30-0022637f0a83 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:05.347975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-efdde00c-fd9d-40e2-9a30-0022637f0a83 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:05.348400 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-efdde00c-fd9d-40e2-9a30-0022637f0a83 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:05.376576 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-efdde00c-fd9d-40e2-9a30-0022637f0a83 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe/ips" status: 200 len: 149 microversion: 2.1 time: 0.044114 Aug 31 12:36:05.377652 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 335/663] 10.222.0.79 () {58 vars in 1248 bytes} [Wed Aug 31 12:36:05 2022] GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:36:06.477239 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b00ba790-81ad-4818-a7a4-9d9b47b2bc98 tempest-VolumesTestJSON-1410060531 tempest-VolumesTestJSON-1410060531-project] Calling method '.version_select at 0x7f8d16fedb80>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:06.525278 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b00ba790-81ad-4818-a7a4-9d9b47b2bc98 tempest-VolumesTestJSON-1410060531 tempest-VolumesTestJSON-1410060531-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/2984e387-8b81-480a-aa62-c6697326c7ec" status: 200 len: 350 microversion: 2.1 time: 0.051817 Aug 31 12:36:06.525875 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 329/664] 10.222.0.79 () {58 vars in 1245 bytes} [Wed Aug 31 12:36:06 2022] GET /compute/v2.1/os-volumes/2984e387-8b81-480a-aa62-c6697326c7ec => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:36:06.757581 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-6563cef3-805c-4043-868c-64278387b6d7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0e00007-bb8c-4bab-b103-bb5dc93a9df3"}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:36:06.760235 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-6563cef3-805c-4043-868c-64278387b6d7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d921f6f0-2017-4941-8d52-1abe875c6ebe] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:06.766529 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6563cef3-805c-4043-868c-64278387b6d7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:06.767064 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6563cef3-805c-4043-868c-64278387b6d7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:06.767497 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6563cef3-805c-4043-868c-64278387b6d7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:06.768378 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6563cef3-805c-4043-868c-64278387b6d7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:06.769023 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6563cef3-805c-4043-868c-64278387b6d7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:06.769424 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6563cef3-805c-4043-868c-64278387b6d7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:06.772842 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:07.041638 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-6563cef3-805c-4043-868c-64278387b6d7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "POST /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287650 Aug 31 12:36:07.042306 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 336/665] 10.222.0.79 () {60 vars in 1323 bytes} [Wed Aug 31 12:36:06 2022] POST /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:36:07.896163 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-771eac17-db48-49a2-b04f-6c0ee0e6d422 tempest-VolumesTestJSON-1410060531 tempest-VolumesTestJSON-1410060531-project] Calling method '.version_select at 0x7f8d16fe5e50>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:07.948807 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-771eac17-db48-49a2-b04f-6c0ee0e6d422 tempest-VolumesTestJSON-1410060531 tempest-VolumesTestJSON-1410060531-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/e6ed3b1a-003c-4e3d-a50b-01359fffe677" status: 200 len: 349 microversion: 2.1 time: 0.056783 Aug 31 12:36:07.949371 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 330/666] 10.222.0.79 () {58 vars in 1245 bytes} [Wed Aug 31 12:36:07 2022] GET /compute/v2.1/os-volumes/e6ed3b1a-003c-4e3d-a50b-01359fffe677 => generated 349 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:36:09.301335 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-592ed7e1-e25a-4830-b658-78325de7a737 tempest-VolumesTestJSON-1410060531 tempest-VolumesTestJSON-1410060531-project] Calling method '.version_select at 0x7f8d16ff7280>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:09.348548 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-592ed7e1-e25a-4830-b658-78325de7a737 tempest-VolumesTestJSON-1410060531 tempest-VolumesTestJSON-1410060531-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/4710e503-9c95-49be-83c3-6ebfd8845a48" status: 200 len: 351 microversion: 2.1 time: 0.051266 Aug 31 12:36:09.349113 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 337/667] 10.222.0.79 () {58 vars in 1245 bytes} [Wed Aug 31 12:36:09 2022] GET /compute/v2.1/os-volumes/4710e503-9c95-49be-83c3-6ebfd8845a48 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:36:09.362775 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-e7cafa3a-f0be-4558-a6b6-2bcd36fd82b2 tempest-VolumesTestJSON-1410060531 tempest-VolumesTestJSON-1410060531-project] Calling method '.version_select at 0x7f8d17071700>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:09.446998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-e7cafa3a-f0be-4558-a6b6-2bcd36fd82b2 tempest-VolumesTestJSON-1410060531 tempest-VolumesTestJSON-1410060531-project] 10.222.0.79 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.088426 Aug 31 12:36:09.448101 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 331/668] 10.222.0.79 () {58 vars in 1134 bytes} [Wed Aug 31 12:36:09 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:09.461460 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-b19d67b8-4ba8-42f3-9119-afb5c4cfc8eb tempest-VolumesTestJSON-1410060531 tempest-VolumesTestJSON-1410060531-project] Calling method '.version_select at 0x7f8d173429d0>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:09.544719 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-b19d67b8-4ba8-42f3-9119-afb5c4cfc8eb tempest-VolumesTestJSON-1410060531 tempest-VolumesTestJSON-1410060531-project] 10.222.0.79 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.087571 Aug 31 12:36:09.545286 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 338/669] 10.222.0.79 () {58 vars in 1149 bytes} [Wed Aug 31 12:36:09 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:36:09.558868 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-2c63c7bb-cb86-47a6-8490-eaf3216db408 tempest-VolumesTestJSON-1410060531 tempest-VolumesTestJSON-1410060531-project] Calling method '.version_select at 0x7f8d17026310>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:09.641150 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-2c63c7bb-cb86-47a6-8490-eaf3216db408 tempest-VolumesTestJSON-1410060531 tempest-VolumesTestJSON-1410060531-project] 10.222.0.79 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.085785 Aug 31 12:36:09.641718 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 332/670] 10.222.0.79 () {58 vars in 1134 bytes} [Wed Aug 31 12:36:09 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:09.655300 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-2830290a-1215-47de-9d55-d6e7d9ed1faa tempest-VolumesTestJSON-1410060531 tempest-VolumesTestJSON-1410060531-project] Calling method '.version_select at 0x7f8d17328160>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:09.743354 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-2830290a-1215-47de-9d55-d6e7d9ed1faa tempest-VolumesTestJSON-1410060531 tempest-VolumesTestJSON-1410060531-project] 10.222.0.79 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.091694 Aug 31 12:36:09.743961 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 339/671] 10.222.0.79 () {58 vars in 1167 bytes} [Wed Aug 31 12:36:09 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:36:09.757766 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-9407845a-4189-4779-9e0d-e28a5b566e2b tempest-VolumesTestJSON-1410060531 tempest-VolumesTestJSON-1410060531-project] Calling method '.version_select at 0x7f8d170ee940>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:09.843536 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-9407845a-4189-4779-9e0d-e28a5b566e2b tempest-VolumesTestJSON-1410060531 tempest-VolumesTestJSON-1410060531-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.090276 Aug 31 12:36:09.844153 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 333/672] 10.222.0.79 () {58 vars in 1170 bytes} [Wed Aug 31 12:36:09 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:36:09.857243 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-6595716b-a13f-482f-9d17-b705201f0245 tempest-VolumesTestJSON-1410060531 tempest-VolumesTestJSON-1410060531-project] Calling method '.version_select at 0x7f8d16f9ac10>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:09.941612 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-6595716b-a13f-482f-9d17-b705201f0245 tempest-VolumesTestJSON-1410060531 tempest-VolumesTestJSON-1410060531-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.088028 Aug 31 12:36:09.942201 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 340/673] 10.222.0.79 () {58 vars in 1155 bytes} [Wed Aug 31 12:36:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:09.955769 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-9510a48d-cc5f-488d-9915-e7df483322ba tempest-VolumesTestJSON-1410060531 tempest-VolumesTestJSON-1410060531-project] Calling method '.version_select at 0x7f8d17071430>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:10.042453 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-9510a48d-cc5f-488d-9915-e7df483322ba tempest-VolumesTestJSON-1410060531 tempest-VolumesTestJSON-1410060531-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.090396 Aug 31 12:36:10.043064 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 334/674] 10.222.0.79 () {58 vars in 1188 bytes} [Wed Aug 31 12:36:09 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:36:10.055947 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-9cb4a179-85aa-4dfd-8c9f-aac29d43ebf1 tempest-VolumesTestJSON-1410060531 tempest-VolumesTestJSON-1410060531-project] Calling method '.version_select at 0x7f8d16f9aa60>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:10.141325 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-9cb4a179-85aa-4dfd-8c9f-aac29d43ebf1 tempest-VolumesTestJSON-1410060531 tempest-VolumesTestJSON-1410060531-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.089254 Aug 31 12:36:10.141897 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 341/675] 10.222.0.79 () {58 vars in 1155 bytes} [Wed Aug 31 12:36:10 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:13.560628 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_api:SELECT=5 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:13.561375 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=1 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:13.565240 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-103092d6-214b-494f-990f-99648c7ba4d2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Action: 'create', calling method: .version_select at 0x7f8d1704b4c0>, body: {"keypair": {"name": "tempest-keypair-1229571913", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9u2NdPLfCnGXtCWsZUaX1WHB8nyv2ibW2nI1hN3u4vu7od4VJHKix/6iyIbTCiMJllz0eAoduoip1sCp+5PHQaoEvZvkDc+SWQIDcN/+tdegTTOCfTBLxYPdZ6iXHexA=="}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:36:13.582609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-103092d6-214b-494f-990f-99648c7ba4d2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Getting quotas for project 8f6da846ab4f45a6ac4b2e34bf52abfc. Resources: {'key_pairs'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:36:13.586763 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-103092d6-214b-494f-990f-99648c7ba4d2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Getting quotas for user d277532df42244c693b5e51e9fd0c459 and project 8f6da846ab4f45a6ac4b2e34bf52abfc. Resources: {'key_pairs'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:36:13.609600 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-103092d6-214b-494f-990f-99648c7ba4d2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050111 Aug 31 12:36:13.610310 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 335/676] 10.222.0.79 () {60 vars in 1159 bytes} [Wed Aug 31 12:36:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:36:15.112899 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-a4d40106-09b3-4f6c-a58d-ac11c6915ad5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1759307091", "imageRef": "2aaf4ebd-395b-468e-bb6b-c663d01edea0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ccc93a47-ca46-4185-ba4c-b528eb9d4e58"}], "security_groups": [{"name": "tempest-securitygroup--80711988"}], "key_name": "tempest-keypair-1229571913", "user_data": "}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:36:15.223360 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.network.neutron [None req-a4d40106-09b3-4f6c-a58d-ac11c6915ad5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] validate_networks() for [('ccc93a47-ca46-4185-ba4c-b528eb9d4e58', None, None, None, None, None)] {{(pid=120749) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:36:15.637789 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-a4d40106-09b3-4f6c-a58d-ac11c6915ad5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Flavor limits 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:36:15.638136 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-a4d40106-09b3-4f6c-a58d-ac11c6915ad5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Image limits 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:36:15.638595 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-a4d40106-09b3-4f6c-a58d-ac11c6915ad5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Flavor pref 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:36:15.639108 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-a4d40106-09b3-4f6c-a58d-ac11c6915ad5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Image pref 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:36:15.639509 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-a4d40106-09b3-4f6c-a58d-ac11c6915ad5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:36:15.648812 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a4d40106-09b3-4f6c-a58d-ac11c6915ad5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:15.649295 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a4d40106-09b3-4f6c-a58d-ac11c6915ad5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:15.650421 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a4d40106-09b3-4f6c-a58d-ac11c6915ad5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:15.650421 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a4d40106-09b3-4f6c-a58d-ac11c6915ad5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:15.650962 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a4d40106-09b3-4f6c-a58d-ac11c6915ad5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:15.651297 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a4d40106-09b3-4f6c-a58d-ac11c6915ad5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:15.669294 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-a4d40106-09b3-4f6c-a58d-ac11c6915ad5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Getting quotas for project 8f6da846ab4f45a6ac4b2e34bf52abfc. Resources: {'cores', 'ram', 'instances'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:36:15.673392 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-a4d40106-09b3-4f6c-a58d-ac11c6915ad5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Getting quotas for user d277532df42244c693b5e51e9fd0c459 and project 8f6da846ab4f45a6ac4b2e34bf52abfc. Resources: {'cores', 'ram', 'instances'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:36:15.686003 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-a4d40106-09b3-4f6c-a58d-ac11c6915ad5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Going to run 1 instances... {{(pid=120749) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:36:15.688447 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-a4d40106-09b3-4f6c-a58d-ac11c6915ad5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d2bf3eb8-923d-4d45-be04-9bbb01430123] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aaf4ebd-395b-468e-bb6b-c663d01edea0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:36:15.755233 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-a4d40106-09b3-4f6c-a58d-ac11c6915ad5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.646694 Aug 31 12:36:15.762960 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 342/677] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 31 12:36:15 2022] POST /compute/v2.1/servers => generated 400 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:36:15.768173 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-1ceab692-6788-4848-b012-8500e14f7f0a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:15.768814 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-1ceab692-6788-4848-b012-8500e14f7f0a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d2bf3eb8-923d-4d45-be04-9bbb01430123] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:15.834294 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-1ceab692-6788-4848-b012-8500e14f7f0a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:15.846500 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-1ceab692-6788-4848-b012-8500e14f7f0a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123" status: 200 len: 1242 microversion: 2.1 time: 0.081842 Aug 31 12:36:15.847169 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 336/678] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:15 2022] GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:16.867334 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-b41dd517-9b58-44c8-b739-eb59883f4b40 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:16.868134 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-b41dd517-9b58-44c8-b739-eb59883f4b40 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d2bf3eb8-923d-4d45-be04-9bbb01430123] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:16.876009 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b41dd517-9b58-44c8-b739-eb59883f4b40 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:16.876589 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b41dd517-9b58-44c8-b739-eb59883f4b40 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:16.877091 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b41dd517-9b58-44c8-b739-eb59883f4b40 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:16.877871 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b41dd517-9b58-44c8-b739-eb59883f4b40 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:16.878394 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b41dd517-9b58-44c8-b739-eb59883f4b40 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:16.878809 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b41dd517-9b58-44c8-b739-eb59883f4b40 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:16.944567 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-b41dd517-9b58-44c8-b739-eb59883f4b40 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:16.952893 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-b41dd517-9b58-44c8-b739-eb59883f4b40 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123" status: 200 len: 1294 microversion: 2.1 time: 0.089766 Aug 31 12:36:16.953469 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 343/679] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:16 2022] GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123 => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:17.975057 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-a3d869f1-e61b-4501-b1f6-037c49729749 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:17.976210 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-a3d869f1-e61b-4501-b1f6-037c49729749 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d2bf3eb8-923d-4d45-be04-9bbb01430123] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:17.983064 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a3d869f1-e61b-4501-b1f6-037c49729749 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:17.983547 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a3d869f1-e61b-4501-b1f6-037c49729749 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:17.983973 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a3d869f1-e61b-4501-b1f6-037c49729749 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:17.984666 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a3d869f1-e61b-4501-b1f6-037c49729749 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:17.985152 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a3d869f1-e61b-4501-b1f6-037c49729749 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:17.985592 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a3d869f1-e61b-4501-b1f6-037c49729749 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:18.214742 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-a3d869f1-e61b-4501-b1f6-037c49729749 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:18.222410 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-a3d869f1-e61b-4501-b1f6-037c49729749 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123" status: 200 len: 1366 microversion: 2.1 time: 0.251350 Aug 31 12:36:18.223008 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 337/680] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:17 2022] GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:18.453248 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-b7c2aec7-af53-4c68-aeae-0aeae4b57f1e req-5526178f-b1e8-4fc4-ba18-098dc7b17aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2bf3eb8-923d-4d45-be04-9bbb01430123", "tag": "2ab2322c-99cd-42b9-8261-6f9850b02e6d"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:36:18.472924 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-b7c2aec7-af53-4c68-aeae-0aeae4b57f1e req-5526178f-b1e8-4fc4-ba18-098dc7b17aa4 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:18.474221 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-b7c2aec7-af53-4c68-aeae-0aeae4b57f1e req-5526178f-b1e8-4fc4-ba18-098dc7b17aa4 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:18.475894 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-b7c2aec7-af53-4c68-aeae-0aeae4b57f1e req-5526178f-b1e8-4fc4-ba18-098dc7b17aa4 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:18.499076 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-b7c2aec7-af53-4c68-aeae-0aeae4b57f1e req-5526178f-b1e8-4fc4-ba18-098dc7b17aa4 service nova] Creating event network-changed:2ab2322c-99cd-42b9-8261-6f9850b02e6d for instance d2bf3eb8-923d-4d45-be04-9bbb01430123 on hv-cinder-85528 Aug 31 12:36:18.509328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-b7c2aec7-af53-4c68-aeae-0aeae4b57f1e req-5526178f-b1e8-4fc4-ba18-098dc7b17aa4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065000 Aug 31 12:36:18.510385 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 344/681] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:36:19.246757 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b7a523de-11f8-4daa-8cbf-f522b2709754 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:19.246757 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-b7a523de-11f8-4daa-8cbf-f522b2709754 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d2bf3eb8-923d-4d45-be04-9bbb01430123] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:19.252769 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b7a523de-11f8-4daa-8cbf-f522b2709754 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:19.253339 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b7a523de-11f8-4daa-8cbf-f522b2709754 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:19.253871 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b7a523de-11f8-4daa-8cbf-f522b2709754 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:19.254653 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b7a523de-11f8-4daa-8cbf-f522b2709754 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:19.255495 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b7a523de-11f8-4daa-8cbf-f522b2709754 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:19.255986 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b7a523de-11f8-4daa-8cbf-f522b2709754 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:19.399456 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b7a523de-11f8-4daa-8cbf-f522b2709754 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:19.407497 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b7a523de-11f8-4daa-8cbf-f522b2709754 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123" status: 200 len: 1366 microversion: 2.1 time: 0.167517 Aug 31 12:36:19.408132 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 338/682] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:19 2022] GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:20.430929 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-c5adcba8-669d-4f92-8850-a1ea2b188bfc tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:20.431728 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-c5adcba8-669d-4f92-8850-a1ea2b188bfc tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d2bf3eb8-923d-4d45-be04-9bbb01430123] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:20.437820 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c5adcba8-669d-4f92-8850-a1ea2b188bfc tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:20.438307 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c5adcba8-669d-4f92-8850-a1ea2b188bfc tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:20.438741 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c5adcba8-669d-4f92-8850-a1ea2b188bfc tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:20.439467 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c5adcba8-669d-4f92-8850-a1ea2b188bfc tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:20.439920 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c5adcba8-669d-4f92-8850-a1ea2b188bfc tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:20.440815 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c5adcba8-669d-4f92-8850-a1ea2b188bfc tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:20.581352 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-c5adcba8-669d-4f92-8850-a1ea2b188bfc tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:20.590265 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-c5adcba8-669d-4f92-8850-a1ea2b188bfc tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123" status: 200 len: 1366 microversion: 2.1 time: 0.164604 Aug 31 12:36:20.590837 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 345/683] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:20 2022] GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:21.612012 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-942c2493-e8f5-4832-b6c7-cca07183d237 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:21.612603 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-942c2493-e8f5-4832-b6c7-cca07183d237 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d2bf3eb8-923d-4d45-be04-9bbb01430123] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:21.620419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-942c2493-e8f5-4832-b6c7-cca07183d237 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:21.620897 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-942c2493-e8f5-4832-b6c7-cca07183d237 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:21.621381 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-942c2493-e8f5-4832-b6c7-cca07183d237 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:21.622015 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-942c2493-e8f5-4832-b6c7-cca07183d237 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:21.622459 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-942c2493-e8f5-4832-b6c7-cca07183d237 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:21.622930 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-942c2493-e8f5-4832-b6c7-cca07183d237 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:21.759588 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-942c2493-e8f5-4832-b6c7-cca07183d237 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:21.767807 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-942c2493-e8f5-4832-b6c7-cca07183d237 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123" status: 200 len: 1366 microversion: 2.1 time: 0.159697 Aug 31 12:36:21.768388 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 339/684] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:21 2022] GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:22.792168 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-8bfca8ec-b038-41a2-9d5a-948c7c771fc7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:22.792796 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-8bfca8ec-b038-41a2-9d5a-948c7c771fc7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d2bf3eb8-923d-4d45-be04-9bbb01430123] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:22.800312 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8bfca8ec-b038-41a2-9d5a-948c7c771fc7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:22.800824 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8bfca8ec-b038-41a2-9d5a-948c7c771fc7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:22.801652 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8bfca8ec-b038-41a2-9d5a-948c7c771fc7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:22.802274 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8bfca8ec-b038-41a2-9d5a-948c7c771fc7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:22.802730 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8bfca8ec-b038-41a2-9d5a-948c7c771fc7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:22.803702 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8bfca8ec-b038-41a2-9d5a-948c7c771fc7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:22.961997 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8bfca8ec-b038-41a2-9d5a-948c7c771fc7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:22.972032 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-8bfca8ec-b038-41a2-9d5a-948c7c771fc7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123" status: 200 len: 1366 microversion: 2.1 time: 0.186298 Aug 31 12:36:22.973190 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 346/685] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:22 2022] GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:23.994403 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b8689539-5790-4904-8191-6791993753e8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:23.994981 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-b8689539-5790-4904-8191-6791993753e8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d2bf3eb8-923d-4d45-be04-9bbb01430123] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:24.001833 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8689539-5790-4904-8191-6791993753e8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:24.002348 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8689539-5790-4904-8191-6791993753e8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:24.002971 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8689539-5790-4904-8191-6791993753e8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:24.003445 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8689539-5790-4904-8191-6791993753e8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:24.003887 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8689539-5790-4904-8191-6791993753e8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:24.004299 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8689539-5790-4904-8191-6791993753e8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:24.148241 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b8689539-5790-4904-8191-6791993753e8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:24.157427 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b8689539-5790-4904-8191-6791993753e8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123" status: 200 len: 1366 microversion: 2.1 time: 0.167251 Aug 31 12:36:24.158191 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 340/686] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:23 2022] GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:25.180002 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-4f00c7d8-ef41-4426-9bcc-42f76ac2f5c5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:25.180860 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-4f00c7d8-ef41-4426-9bcc-42f76ac2f5c5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d2bf3eb8-923d-4d45-be04-9bbb01430123] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:25.187549 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4f00c7d8-ef41-4426-9bcc-42f76ac2f5c5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:25.188037 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4f00c7d8-ef41-4426-9bcc-42f76ac2f5c5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:25.188467 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4f00c7d8-ef41-4426-9bcc-42f76ac2f5c5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:25.189162 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4f00c7d8-ef41-4426-9bcc-42f76ac2f5c5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:25.189619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4f00c7d8-ef41-4426-9bcc-42f76ac2f5c5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:25.190035 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4f00c7d8-ef41-4426-9bcc-42f76ac2f5c5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:25.334714 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-4f00c7d8-ef41-4426-9bcc-42f76ac2f5c5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:25.343614 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-4f00c7d8-ef41-4426-9bcc-42f76ac2f5c5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123" status: 200 len: 1366 microversion: 2.1 time: 0.167544 Aug 31 12:36:25.344257 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 347/687] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:25 2022] GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:26.365820 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-6d7e7831-53d5-4e40-82ce-659c445aea7c tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:26.366430 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-6d7e7831-53d5-4e40-82ce-659c445aea7c tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d2bf3eb8-923d-4d45-be04-9bbb01430123] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:26.368949 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell0:SELECT=6 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:26.374385 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6d7e7831-53d5-4e40-82ce-659c445aea7c tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:26.374754 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6d7e7831-53d5-4e40-82ce-659c445aea7c tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:26.375216 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6d7e7831-53d5-4e40-82ce-659c445aea7c tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:26.375908 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6d7e7831-53d5-4e40-82ce-659c445aea7c tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:26.376354 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6d7e7831-53d5-4e40-82ce-659c445aea7c tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:26.376774 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6d7e7831-53d5-4e40-82ce-659c445aea7c tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:26.560695 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-6d7e7831-53d5-4e40-82ce-659c445aea7c tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:26.569028 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-6d7e7831-53d5-4e40-82ce-659c445aea7c tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123" status: 200 len: 1366 microversion: 2.1 time: 0.207241 Aug 31 12:36:26.569747 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 341/688] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:26 2022] GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:27.596161 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-11caa26f-9a7c-421e-9cda-ddb66a5c2ba0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:27.597163 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-11caa26f-9a7c-421e-9cda-ddb66a5c2ba0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d2bf3eb8-923d-4d45-be04-9bbb01430123] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:27.602652 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=2 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:27.603895 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=6 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:27.614340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-11caa26f-9a7c-421e-9cda-ddb66a5c2ba0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:27.615161 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-11caa26f-9a7c-421e-9cda-ddb66a5c2ba0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:27.616014 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-11caa26f-9a7c-421e-9cda-ddb66a5c2ba0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:27.617224 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-11caa26f-9a7c-421e-9cda-ddb66a5c2ba0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:27.617985 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-11caa26f-9a7c-421e-9cda-ddb66a5c2ba0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:27.618665 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-11caa26f-9a7c-421e-9cda-ddb66a5c2ba0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:27.790068 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-11caa26f-9a7c-421e-9cda-ddb66a5c2ba0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:27.799246 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-11caa26f-9a7c-421e-9cda-ddb66a5c2ba0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123" status: 200 len: 1366 microversion: 2.1 time: 0.209801 Aug 31 12:36:27.813834 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 348/689] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:27 2022] GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:27.871785 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-73111e46-a014-4d53-b0df-d4708a6b34e5 req-18922afa-6f9a-42dd-8a8c-4497a16dfd55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2bf3eb8-923d-4d45-be04-9bbb01430123", "name": "network-vif-plugged", "status": "completed", "tag": "2ab2322c-99cd-42b9-8261-6f9850b02e6d"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:36:27.882711 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-73111e46-a014-4d53-b0df-d4708a6b34e5 req-18922afa-6f9a-42dd-8a8c-4497a16dfd55 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:27.883971 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-73111e46-a014-4d53-b0df-d4708a6b34e5 req-18922afa-6f9a-42dd-8a8c-4497a16dfd55 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:27.884391 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-73111e46-a014-4d53-b0df-d4708a6b34e5 req-18922afa-6f9a-42dd-8a8c-4497a16dfd55 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:27.896418 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-73111e46-a014-4d53-b0df-d4708a6b34e5 req-18922afa-6f9a-42dd-8a8c-4497a16dfd55 service nova] Creating event network-vif-plugged:2ab2322c-99cd-42b9-8261-6f9850b02e6d for instance d2bf3eb8-923d-4d45-be04-9bbb01430123 on hv-cinder-85528 Aug 31 12:36:27.903276 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-73111e46-a014-4d53-b0df-d4708a6b34e5 req-18922afa-6f9a-42dd-8a8c-4497a16dfd55 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035249 Aug 31 12:36:27.904878 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 342/690] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:36:28.821202 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-8021c63d-31ab-4a2f-92cc-49d45097240a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:28.822047 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-8021c63d-31ab-4a2f-92cc-49d45097240a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d2bf3eb8-923d-4d45-be04-9bbb01430123] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:28.824259 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:28.830191 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8021c63d-31ab-4a2f-92cc-49d45097240a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:28.830677 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8021c63d-31ab-4a2f-92cc-49d45097240a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:28.831157 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8021c63d-31ab-4a2f-92cc-49d45097240a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:28.831901 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8021c63d-31ab-4a2f-92cc-49d45097240a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:28.832534 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8021c63d-31ab-4a2f-92cc-49d45097240a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:28.833097 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8021c63d-31ab-4a2f-92cc-49d45097240a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:28.978059 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8021c63d-31ab-4a2f-92cc-49d45097240a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:28.985925 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-8021c63d-31ab-4a2f-92cc-49d45097240a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123" status: 200 len: 1366 microversion: 2.1 time: 0.169249 Aug 31 12:36:28.986557 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 349/691] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:28 2022] GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:30.010607 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-069360f7-649a-4709-a3b9-3e4de8a9f1d7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:30.011332 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-069360f7-649a-4709-a3b9-3e4de8a9f1d7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d2bf3eb8-923d-4d45-be04-9bbb01430123] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:30.017793 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-069360f7-649a-4709-a3b9-3e4de8a9f1d7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:30.018273 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-069360f7-649a-4709-a3b9-3e4de8a9f1d7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:30.018731 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-069360f7-649a-4709-a3b9-3e4de8a9f1d7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:30.019447 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-069360f7-649a-4709-a3b9-3e4de8a9f1d7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:30.019892 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-069360f7-649a-4709-a3b9-3e4de8a9f1d7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:30.020320 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-069360f7-649a-4709-a3b9-3e4de8a9f1d7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:30.175931 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-069360f7-649a-4709-a3b9-3e4de8a9f1d7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:30.183891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-069360f7-649a-4709-a3b9-3e4de8a9f1d7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123" status: 200 len: 1556 microversion: 2.1 time: 0.178899 Aug 31 12:36:30.184466 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 343/692] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:30 2022] GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123 => generated 1556 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:30.205095 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-b18efa6a-33e5-4e47-81c8-e439d4fc2199 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:30.205684 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-b18efa6a-33e5-4e47-81c8-e439d4fc2199 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d2bf3eb8-923d-4d45-be04-9bbb01430123] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:30.213353 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b18efa6a-33e5-4e47-81c8-e439d4fc2199 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:30.213841 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b18efa6a-33e5-4e47-81c8-e439d4fc2199 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:30.214269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b18efa6a-33e5-4e47-81c8-e439d4fc2199 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:30.215336 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b18efa6a-33e5-4e47-81c8-e439d4fc2199 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:30.215806 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b18efa6a-33e5-4e47-81c8-e439d4fc2199 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:30.216227 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b18efa6a-33e5-4e47-81c8-e439d4fc2199 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:30.295740 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-b18efa6a-33e5-4e47-81c8-e439d4fc2199 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094449 Aug 31 12:36:30.296310 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 350/693] 10.222.0.79 () {58 vars in 1275 bytes} [Wed Aug 31 12:36:30 2022] GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:36:31.391463 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-af2e4328-123e-4622-bd45-79c0000e49f4 req-01718bd8-667b-4793-b81a-06003eda72a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2bf3eb8-923d-4d45-be04-9bbb01430123", "tag": "2ab2322c-99cd-42b9-8261-6f9850b02e6d"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:36:31.406625 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-af2e4328-123e-4622-bd45-79c0000e49f4 req-01718bd8-667b-4793-b81a-06003eda72a4 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:31.407251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-af2e4328-123e-4622-bd45-79c0000e49f4 req-01718bd8-667b-4793-b81a-06003eda72a4 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:31.407697 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-af2e4328-123e-4622-bd45-79c0000e49f4 req-01718bd8-667b-4793-b81a-06003eda72a4 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:31.422202 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-af2e4328-123e-4622-bd45-79c0000e49f4 req-01718bd8-667b-4793-b81a-06003eda72a4 service nova] Creating event network-changed:2ab2322c-99cd-42b9-8261-6f9850b02e6d for instance d2bf3eb8-923d-4d45-be04-9bbb01430123 on hv-cinder-85528 Aug 31 12:36:31.428506 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-af2e4328-123e-4622-bd45-79c0000e49f4 req-01718bd8-667b-4793-b81a-06003eda72a4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189983 Aug 31 12:36:31.429114 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 344/694] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:36:35.992397 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-b83a36a9-c8c0-461e-adc8-077fe53c3452 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:35.994726 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-b83a36a9-c8c0-461e-adc8-077fe53c3452 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:36.001309 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b83a36a9-c8c0-461e-adc8-077fe53c3452 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:36.001738 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b83a36a9-c8c0-461e-adc8-077fe53c3452 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:36.002194 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b83a36a9-c8c0-461e-adc8-077fe53c3452 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:36.002900 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b83a36a9-c8c0-461e-adc8-077fe53c3452 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:36.003427 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b83a36a9-c8c0-461e-adc8-077fe53c3452 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:36.003869 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b83a36a9-c8c0-461e-adc8-077fe53c3452 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:36.036881 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-b83a36a9-c8c0-461e-adc8-077fe53c3452 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049731 Aug 31 12:36:36.037550 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 351/695] 10.222.0.79 () {60 vars in 1343 bytes} [Wed Aug 31 12:36:35 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:36.117944 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-d9f2756c-1307-4e2f-bfc4-c6794c10abb5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:36.118806 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-d9f2756c-1307-4e2f-bfc4-c6794c10abb5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:36.126649 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d9f2756c-1307-4e2f-bfc4-c6794c10abb5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:36.127382 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d9f2756c-1307-4e2f-bfc4-c6794c10abb5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:36.128151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d9f2756c-1307-4e2f-bfc4-c6794c10abb5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:36.128956 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d9f2756c-1307-4e2f-bfc4-c6794c10abb5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:36.129418 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d9f2756c-1307-4e2f-bfc4-c6794c10abb5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:36.129849 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d9f2756c-1307-4e2f-bfc4-c6794c10abb5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:36.169820 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-d9f2756c-1307-4e2f-bfc4-c6794c10abb5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Going to try to terminate instance {{(pid=120750) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:36:36.266110 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-d9f2756c-1307-4e2f-bfc4-c6794c10abb5 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 204 len: 0 microversion: 2.20 time: 0.152544 Aug 31 12:36:36.270731 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 345/696] 10.222.0.79 () {60 vars in 1280 bytes} [Wed Aug 31 12:36:36 2022] DELETE /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 31 12:36:36.277200 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-2478b3f5-987d-4274-8802-1f3920571fc8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:36.277801 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-2478b3f5-987d-4274-8802-1f3920571fc8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:36.284754 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2478b3f5-987d-4274-8802-1f3920571fc8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:36.285211 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2478b3f5-987d-4274-8802-1f3920571fc8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:36.285649 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2478b3f5-987d-4274-8802-1f3920571fc8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:36.286350 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2478b3f5-987d-4274-8802-1f3920571fc8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:36.286799 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2478b3f5-987d-4274-8802-1f3920571fc8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:36.287265 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2478b3f5-987d-4274-8802-1f3920571fc8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:36.455659 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-2478b3f5-987d-4274-8802-1f3920571fc8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:36.465467 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-2478b3f5-987d-4274-8802-1f3920571fc8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:36.466985 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-2478b3f5-987d-4274-8802-1f3920571fc8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:36.468186 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-2478b3f5-987d-4274-8802-1f3920571fc8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1724 microversion: 2.20 time: 0.195970 Aug 31 12:36:36.468757 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 352/697] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:36 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:36:37.494648 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b4d7de24-6ab1-4789-b529-de75d663f1c8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:37.495389 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-b4d7de24-6ab1-4789-b529-de75d663f1c8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:37.502650 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b4d7de24-6ab1-4789-b529-de75d663f1c8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:37.503212 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b4d7de24-6ab1-4789-b529-de75d663f1c8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:37.503642 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b4d7de24-6ab1-4789-b529-de75d663f1c8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:37.504339 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b4d7de24-6ab1-4789-b529-de75d663f1c8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:37.504790 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b4d7de24-6ab1-4789-b529-de75d663f1c8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:37.505201 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b4d7de24-6ab1-4789-b529-de75d663f1c8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:37.728446 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b4d7de24-6ab1-4789-b529-de75d663f1c8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:37.738826 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b4d7de24-6ab1-4789-b529-de75d663f1c8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:37.740598 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b4d7de24-6ab1-4789-b529-de75d663f1c8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee19faf2a2c54b19a9dc01d28f045b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d78bffa2c740b1aa7e09882a90eb9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:37.741809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b4d7de24-6ab1-4789-b529-de75d663f1c8 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 200 len: 1724 microversion: 2.20 time: 0.251798 Aug 31 12:36:37.742540 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 346/698] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:37 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:36:38.527569 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-144d70a5-8c7a-402d-8635-ce6297612cb3 req-3f515992-cf12-49b8-8351-d4310cb6688f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bee1640-e8d5-48a7-b437-414aac42397a", "name": "network-vif-deleted", "tag": "b673aa1b-a57f-46f1-bb92-bd62f55d451c"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:36:38.542898 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-144d70a5-8c7a-402d-8635-ce6297612cb3 req-3f515992-cf12-49b8-8351-d4310cb6688f service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:38.543582 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-144d70a5-8c7a-402d-8635-ce6297612cb3 req-3f515992-cf12-49b8-8351-d4310cb6688f service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:38.544393 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-144d70a5-8c7a-402d-8635-ce6297612cb3 req-3f515992-cf12-49b8-8351-d4310cb6688f service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:38.557242 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:38.564483 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-144d70a5-8c7a-402d-8635-ce6297612cb3 req-3f515992-cf12-49b8-8351-d4310cb6688f service nova] Creating event network-vif-deleted:b673aa1b-a57f-46f1-bb92-bd62f55d451c for instance 8bee1640-e8d5-48a7-b437-414aac42397a on hv-cinder-85528 Aug 31 12:36:38.570626 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-144d70a5-8c7a-402d-8635-ce6297612cb3 req-3f515992-cf12-49b8-8351-d4310cb6688f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048899 Aug 31 12:36:38.571510 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 353/699] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:36:38.767890 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-1619abbf-acf7-4e49-ac0d-a6b5bc64bbcc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:38.768499 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-1619abbf-acf7-4e49-ac0d-a6b5bc64bbcc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:38.778016 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1619abbf-acf7-4e49-ac0d-a6b5bc64bbcc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:38.778917 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1619abbf-acf7-4e49-ac0d-a6b5bc64bbcc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:38.782936 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1619abbf-acf7-4e49-ac0d-a6b5bc64bbcc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:38.784910 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1619abbf-acf7-4e49-ac0d-a6b5bc64bbcc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:38.787297 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1619abbf-acf7-4e49-ac0d-a6b5bc64bbcc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:38.787919 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1619abbf-acf7-4e49-ac0d-a6b5bc64bbcc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:38.815232 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-1619abbf-acf7-4e49-ac0d-a6b5bc64bbcc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] HTTP exception thrown: Instance 8bee1640-e8d5-48a7-b437-414aac42397a could not be found. Aug 31 12:36:38.816891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-1619abbf-acf7-4e49-ac0d-a6b5bc64bbcc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Request method failure captured: Aug 31 12:36:38.816891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a HTTP/1.1 Aug 31 12:36:38.816891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:36:38.816891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:36:38.816891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:36:38.816891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 0 Aug 31 12:36:38.816891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:36:38.816891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:36:38.816891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:36:38.816891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:36:38.816891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1Q8_fKXu_7R_QGxQKTF7lFiWyT2RAjzIuVPjIM9dyfrljx1xlXnC7qwTfL8uoCLrmDxjoUAGbKrZ1-as7HlKH9zn8Ie9RnJFoQuIgtxkzodw4_WMQMiOoe7YSrL8r3gdFv9pH5SeNHNJOZzft1oVZcsjzrhUw3REkSM22eu5KLeZ3w Aug 31 12:36:38.816891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:36:38.816891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:36:38.816891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:36:38.816891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:36:38.816891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 12:36:38.816891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:36:38.816891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:36:38.816891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: 93d78bffa2c740b1aa7e09882a90eb9a Aug 31 12:36:38.816891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1598873957 Aug 31 12:36:38.816891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:36:38.816891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:36:38.819291 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/93d78bffa2c740b1aa7e09882a90eb9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_93d78bffa2c740b1aa7e09882a90eb9a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/93d78bffa2c740b1aa7e09882a90eb9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/93d78bffa2c740b1aa7e09882a90eb9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:36:38.819291 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1598873957 Aug 31 12:36:38.819291 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: 93d78bffa2c740b1aa7e09882a90eb9a Aug 31 12:36:38.819291 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1598873957 Aug 31 12:36:38.819291 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-AttachVolumeShelveTestJSON-1598873957-project Aug 31 12:36:38.819291 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:36:38.819291 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:36:38.819291 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: ee19faf2a2c54b19a9dc01d28f045b3a Aug 31 12:36:38.819291 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1598873957-project Aug 31 12:36:38.819291 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:36:38.819291 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Instance 8bee1640-e8d5-48a7-b437-414aac42397a could not be found. Aug 31 12:36:38.819291 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'id': '8bee1640-e8d5-48a7-b437-414aac42397a'} Aug 31 12:36:38.820809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:36:38.820809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:36:38.820809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:36:38.820809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:36:38.820809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:36:38.820809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:36:38.820809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:36:38.820809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:36:38.820809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:36:38.820809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:36:38.820809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bee1640-e8d5-48a7-b437-414aac42397a could not be found. Aug 31 12:36:38.820809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:36:38.820809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:36:38.820809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:36:38.820809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:36:38.820809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:36:38.820809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:36:38.820809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:36:38.820809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:36:38.820809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:36:38.822419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:36:38.822419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:36:38.822419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:36:38.822419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:36:38.822419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:36:38.822419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:36:38.822419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:36:38.822419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bee1640-e8d5-48a7-b437-414aac42397a could not be found. Aug 31 12:36:38.822419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:36:38.822419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:36:38.822419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:36:38.822419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:36:38.822419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:36:38.822419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:36:38.822419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:36:38.822419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:36:38.822419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bee1640-e8d5-48a7-b437-414aac42397a could not be found. Aug 31 12:36:38.822419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:36:38.823852 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-1619abbf-acf7-4e49-ac0d-a6b5bc64bbcc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Returning 404 to user: Instance 8bee1640-e8d5-48a7-b437-414aac42397a could not be found. {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:36:38.823852 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-1619abbf-acf7-4e49-ac0d-a6b5bc64bbcc tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 404 len: 111 microversion: 2.20 time: 0.054721 Aug 31 12:36:38.823852 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 347/700] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:38 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 12:36:38.832558 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-22613ef1-e6c5-4ac1-9c35-48e356d5020a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '.version_select at 0x7f8d16fcda60>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:38.862701 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-22613ef1-e6c5-4ac1-9c35-48e356d5020a tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-627371339" status: 204 len: 0 microversion: 2.20 time: 0.036051 Aug 31 12:36:38.864291 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 354/701] 10.222.0.79 () {60 vars in 1259 bytes} [Wed Aug 31 12:36:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-627371339 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 31 12:36:42.834686 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-3ce049ff-e42c-4d10-9435-ff4fb8d997ee tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:42.835304 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-3ce049ff-e42c-4d10-9435-ff4fb8d997ee tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:42.844387 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3ce049ff-e42c-4d10-9435-ff4fb8d997ee tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:42.844892 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3ce049ff-e42c-4d10-9435-ff4fb8d997ee tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:42.845321 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3ce049ff-e42c-4d10-9435-ff4fb8d997ee tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:42.846024 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3ce049ff-e42c-4d10-9435-ff4fb8d997ee tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:42.846475 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3ce049ff-e42c-4d10-9435-ff4fb8d997ee tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:42.846920 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3ce049ff-e42c-4d10-9435-ff4fb8d997ee tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:42.861495 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-3ce049ff-e42c-4d10-9435-ff4fb8d997ee tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] HTTP exception thrown: Instance 8bee1640-e8d5-48a7-b437-414aac42397a could not be found. Aug 31 12:36:42.863099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-3ce049ff-e42c-4d10-9435-ff4fb8d997ee tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Request method failure captured: Aug 31 12:36:42.863099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: DELETE /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a HTTP/1.1 Aug 31 12:36:42.863099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:36:42.863099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:36:42.863099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:36:42.863099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 0 Aug 31 12:36:42.863099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:36:42.863099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:36:42.863099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:36:42.863099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:36:42.863099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1Q8_fKXu_7R_QGxQKTF7lFiWyT2RAjzIuVPjIM9dyfrljx1xlXnC7qwTfL8uoCLrmDxjoUAGbKrZ1-as7HlKH9zn8Ie9RnJFoQuIgtxkzodw4_WMQMiOoe7YSrL8r3gdFv9pH5SeNHNJOZzft1oVZcsjzrhUw3REkSM22eu5KLeZ3w Aug 31 12:36:42.863099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:36:42.863099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:36:42.863099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:36:42.863099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:36:42.863099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 12:36:42.863099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:36:42.863099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:36:42.863099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: 93d78bffa2c740b1aa7e09882a90eb9a Aug 31 12:36:42.863099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1598873957 Aug 31 12:36:42.863099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:36:42.863099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:36:42.865075 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/93d78bffa2c740b1aa7e09882a90eb9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_93d78bffa2c740b1aa7e09882a90eb9a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/93d78bffa2c740b1aa7e09882a90eb9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/93d78bffa2c740b1aa7e09882a90eb9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:36:42.865075 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1598873957 Aug 31 12:36:42.865075 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: 93d78bffa2c740b1aa7e09882a90eb9a Aug 31 12:36:42.865075 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1598873957 Aug 31 12:36:42.865075 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-AttachVolumeShelveTestJSON-1598873957-project Aug 31 12:36:42.865075 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:36:42.865075 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:36:42.865075 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: ee19faf2a2c54b19a9dc01d28f045b3a Aug 31 12:36:42.865075 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1598873957-project Aug 31 12:36:42.865075 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:36:42.865075 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Instance 8bee1640-e8d5-48a7-b437-414aac42397a could not be found. Aug 31 12:36:42.865075 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'id': '8bee1640-e8d5-48a7-b437-414aac42397a'} Aug 31 12:36:42.866004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:36:42.866004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:36:42.866004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:36:42.866004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:36:42.866004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:36:42.866004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:36:42.866004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:36:42.866004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:36:42.866004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:36:42.866004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:36:42.866004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bee1640-e8d5-48a7-b437-414aac42397a could not be found. Aug 31 12:36:42.866004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:36:42.866004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:36:42.866004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:36:42.866004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:36:42.866004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:36:42.866004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:36:42.866004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:36:42.866004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:36:42.866004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:36:42.867514 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:36:42.867514 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 12:36:42.867514 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 12:36:42.867514 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 12:36:42.867514 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 12:36:42.867514 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:36:42.867514 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:36:42.867514 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:36:42.867514 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:36:42.867514 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bee1640-e8d5-48a7-b437-414aac42397a could not be found. Aug 31 12:36:42.867514 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:36:42.867514 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:36:42.867514 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:36:42.867514 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:36:42.867514 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:36:42.867514 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:36:42.867514 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:36:42.867514 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:36:42.867514 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bee1640-e8d5-48a7-b437-414aac42397a could not be found. Aug 31 12:36:42.867514 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:36:42.869074 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-3ce049ff-e42c-4d10-9435-ff4fb8d997ee tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Returning 404 to user: Instance 8bee1640-e8d5-48a7-b437-414aac42397a could not be found. {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:36:42.869074 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-3ce049ff-e42c-4d10-9435-ff4fb8d997ee tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 404 len: 111 microversion: 2.20 time: 0.034150 Aug 31 12:36:42.869074 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 348/702] 10.222.0.79 () {60 vars in 1280 bytes} [Wed Aug 31 12:36:42 2022] DELETE /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 12:36:42.875169 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-80a91bbb-6f0a-4548-8524-496a2b3b6475 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:42.875901 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-80a91bbb-6f0a-4548-8524-496a2b3b6475 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 8bee1640-e8d5-48a7-b437-414aac42397a] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:42.882115 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-80a91bbb-6f0a-4548-8524-496a2b3b6475 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:42.883216 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-80a91bbb-6f0a-4548-8524-496a2b3b6475 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:42.884254 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-80a91bbb-6f0a-4548-8524-496a2b3b6475 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:42.884965 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-80a91bbb-6f0a-4548-8524-496a2b3b6475 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:42.885428 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-80a91bbb-6f0a-4548-8524-496a2b3b6475 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:42.885860 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-80a91bbb-6f0a-4548-8524-496a2b3b6475 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:42.900861 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.wsgi [None req-80a91bbb-6f0a-4548-8524-496a2b3b6475 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] HTTP exception thrown: Instance 8bee1640-e8d5-48a7-b437-414aac42397a could not be found. Aug 31 12:36:42.902474 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-80a91bbb-6f0a-4548-8524-496a2b3b6475 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Request method failure captured: Aug 31 12:36:42.902474 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: request: GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a HTTP/1.1 Aug 31 12:36:42.902474 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept: application/json Aug 31 12:36:42.902474 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept-Encoding: identity Aug 31 12:36:42.902474 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Connection: close Aug 31 12:36:42.902474 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Length: 0 Aug 31 12:36:42.902474 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Type: application/json Aug 31 12:36:42.902474 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Host: 10.222.0.79 Aug 31 12:36:42.902474 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Openstack-System-Scope: None Aug 31 12:36:42.902474 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: User-Agent: python-urllib3/1.26.12 Aug 31 12:36:42.902474 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Auth-Token: gAAAAABjD1Q8_fKXu_7R_QGxQKTF7lFiWyT2RAjzIuVPjIM9dyfrljx1xlXnC7qwTfL8uoCLrmDxjoUAGbKrZ1-as7HlKH9zn8Ie9RnJFoQuIgtxkzodw4_WMQMiOoe7YSrL8r3gdFv9pH5SeNHNJOZzft1oVZcsjzrhUw3REkSM22eu5KLeZ3w Aug 31 12:36:42.902474 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Id: None Aug 31 12:36:42.902474 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Name: None Aug 31 12:36:42.902474 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Identity-Status: Confirmed Aug 31 12:36:42.902474 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Is-Admin-Project: True Aug 31 12:36:42.902474 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 12:36:42.902474 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Id: default Aug 31 12:36:42.902474 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Name: Default Aug 31 12:36:42.902474 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Id: 93d78bffa2c740b1aa7e09882a90eb9a Aug 31 12:36:42.902474 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1598873957 Aug 31 12:36:42.902474 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Role: reader,member Aug 31 12:36:42.902474 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Roles: reader,member Aug 31 12:36:42.904047 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/93d78bffa2c740b1aa7e09882a90eb9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_93d78bffa2c740b1aa7e09882a90eb9a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/93d78bffa2c740b1aa7e09882a90eb9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/93d78bffa2c740b1aa7e09882a90eb9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:36:42.904047 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1598873957 Aug 31 12:36:42.904047 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Id: 93d78bffa2c740b1aa7e09882a90eb9a Aug 31 12:36:42.904047 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1598873957 Aug 31 12:36:42.904047 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User: tempest-AttachVolumeShelveTestJSON-1598873957-project Aug 31 12:36:42.904047 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Id: default Aug 31 12:36:42.904047 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Name: Default Aug 31 12:36:42.904047 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Id: ee19faf2a2c54b19a9dc01d28f045b3a Aug 31 12:36:42.904047 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1598873957-project Aug 31 12:36:42.904047 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: method: > Aug 31 12:36:42.904047 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: exception: Instance 8bee1640-e8d5-48a7-b437-414aac42397a could not be found. Aug 31 12:36:42.904047 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: action_args: {'id': '8bee1640-e8d5-48a7-b437-414aac42397a'} Aug 31 12:36:42.904880 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:36:42.904880 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:36:42.904880 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:36:42.904880 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:36:42.904880 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:36:42.904880 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:36:42.904880 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:36:42.904880 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:36:42.904880 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:36:42.904880 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:36:42.904880 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bee1640-e8d5-48a7-b437-414aac42397a could not be found. Aug 31 12:36:42.904880 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:36:42.904880 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:36:42.904880 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:36:42.904880 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:36:42.904880 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:36:42.904880 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:36:42.904880 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:36:42.904880 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:36:42.904880 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:36:42.906252 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:36:42.906252 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:36:42.906252 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:36:42.906252 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:36:42.906252 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:36:42.906252 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:36:42.906252 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:36:42.906252 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bee1640-e8d5-48a7-b437-414aac42397a could not be found. Aug 31 12:36:42.906252 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:36:42.906252 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:36:42.906252 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:36:42.906252 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:36:42.906252 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:36:42.906252 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:36:42.906252 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:36:42.906252 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:36:42.906252 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bee1640-e8d5-48a7-b437-414aac42397a could not be found. Aug 31 12:36:42.906252 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:36:42.907585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-80a91bbb-6f0a-4548-8524-496a2b3b6475 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Returning 404 to user: Instance 8bee1640-e8d5-48a7-b437-414aac42397a could not be found. {{(pid=120749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:36:42.907585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-80a91bbb-6f0a-4548-8524-496a2b3b6475 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a" status: 404 len: 111 microversion: 2.20 time: 0.033182 Aug 31 12:36:42.907746 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 355/703] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:42 2022] GET /compute/v2.1/servers/8bee1640-e8d5-48a7-b437-414aac42397a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 12:36:46.164864 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-72efdb8c-1a20-42e6-8e39-fafcd36b9151 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:46.165711 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-72efdb8c-1a20-42e6-8e39-fafcd36b9151 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:46.168368 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:46.174342 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-72efdb8c-1a20-42e6-8e39-fafcd36b9151 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:46.174944 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-72efdb8c-1a20-42e6-8e39-fafcd36b9151 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:46.175783 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-72efdb8c-1a20-42e6-8e39-fafcd36b9151 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:46.175987 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-72efdb8c-1a20-42e6-8e39-fafcd36b9151 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:46.176381 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-72efdb8c-1a20-42e6-8e39-fafcd36b9151 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:46.177379 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-72efdb8c-1a20-42e6-8e39-fafcd36b9151 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:46.181616 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:46.196852 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-72efdb8c-1a20-42e6-8e39-fafcd36b9151 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] HTTP exception thrown: Instance 34ecec01-dd25-474d-addd-1d9b8de152b8 could not be found. Aug 31 12:36:46.198420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-72efdb8c-1a20-42e6-8e39-fafcd36b9151 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Request method failure captured: Aug 31 12:36:46.198420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: DELETE /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 HTTP/1.1 Aug 31 12:36:46.198420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:36:46.198420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:36:46.198420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:36:46.198420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 0 Aug 31 12:36:46.198420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:36:46.198420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:36:46.198420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:36:46.198420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:36:46.198420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1Q8_fKXu_7R_QGxQKTF7lFiWyT2RAjzIuVPjIM9dyfrljx1xlXnC7qwTfL8uoCLrmDxjoUAGbKrZ1-as7HlKH9zn8Ie9RnJFoQuIgtxkzodw4_WMQMiOoe7YSrL8r3gdFv9pH5SeNHNJOZzft1oVZcsjzrhUw3REkSM22eu5KLeZ3w Aug 31 12:36:46.198420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:36:46.198420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:36:46.198420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:36:46.198420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:36:46.198420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 12:36:46.198420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:36:46.198420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:36:46.198420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: 93d78bffa2c740b1aa7e09882a90eb9a Aug 31 12:36:46.198420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1598873957 Aug 31 12:36:46.198420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:36:46.198420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:36:46.200439 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/93d78bffa2c740b1aa7e09882a90eb9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_93d78bffa2c740b1aa7e09882a90eb9a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/93d78bffa2c740b1aa7e09882a90eb9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/93d78bffa2c740b1aa7e09882a90eb9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:36:46.200439 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1598873957 Aug 31 12:36:46.200439 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: 93d78bffa2c740b1aa7e09882a90eb9a Aug 31 12:36:46.200439 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1598873957 Aug 31 12:36:46.200439 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-AttachVolumeShelveTestJSON-1598873957-project Aug 31 12:36:46.200439 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:36:46.200439 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:36:46.200439 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: ee19faf2a2c54b19a9dc01d28f045b3a Aug 31 12:36:46.200439 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1598873957-project Aug 31 12:36:46.200439 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:36:46.200439 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Instance 34ecec01-dd25-474d-addd-1d9b8de152b8 could not be found. Aug 31 12:36:46.200439 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'id': '34ecec01-dd25-474d-addd-1d9b8de152b8'} Aug 31 12:36:46.201268 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:36:46.201268 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:36:46.201268 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:36:46.201268 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:36:46.201268 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:36:46.201268 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:36:46.201268 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:36:46.201268 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:36:46.201268 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:36:46.201268 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:36:46.201268 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34ecec01-dd25-474d-addd-1d9b8de152b8 could not be found. Aug 31 12:36:46.201268 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:36:46.201268 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:36:46.201268 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:36:46.201268 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:36:46.201268 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:36:46.201268 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:36:46.201268 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:36:46.201268 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:36:46.201268 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:36:46.202769 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:36:46.202769 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 12:36:46.202769 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 12:36:46.202769 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 12:36:46.202769 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 12:36:46.202769 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:36:46.202769 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:36:46.202769 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:36:46.202769 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:36:46.202769 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34ecec01-dd25-474d-addd-1d9b8de152b8 could not be found. Aug 31 12:36:46.202769 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:36:46.202769 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:36:46.202769 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:36:46.202769 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:36:46.202769 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:36:46.202769 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:36:46.202769 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:36:46.202769 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:36:46.202769 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34ecec01-dd25-474d-addd-1d9b8de152b8 could not be found. Aug 31 12:36:46.202769 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:36:46.204694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-72efdb8c-1a20-42e6-8e39-fafcd36b9151 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Returning 404 to user: Instance 34ecec01-dd25-474d-addd-1d9b8de152b8 could not be found. {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:36:46.204694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-72efdb8c-1a20-42e6-8e39-fafcd36b9151 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "DELETE /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 404 len: 111 microversion: 2.20 time: 0.039249 Aug 31 12:36:46.204694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 349/704] 10.222.0.79 () {60 vars in 1280 bytes} [Wed Aug 31 12:36:46 2022] DELETE /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 12:36:46.208561 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-1c88b811-9e5b-46c8-aa9d-1c6cef28e257 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:46.209176 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-1c88b811-9e5b-46c8-aa9d-1c6cef28e257 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] [instance: 34ecec01-dd25-474d-addd-1d9b8de152b8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:46.216568 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1c88b811-9e5b-46c8-aa9d-1c6cef28e257 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:46.217060 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1c88b811-9e5b-46c8-aa9d-1c6cef28e257 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:46.217496 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1c88b811-9e5b-46c8-aa9d-1c6cef28e257 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:46.218299 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1c88b811-9e5b-46c8-aa9d-1c6cef28e257 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:46.218756 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1c88b811-9e5b-46c8-aa9d-1c6cef28e257 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:46.219224 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1c88b811-9e5b-46c8-aa9d-1c6cef28e257 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:46.234386 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.wsgi [None req-1c88b811-9e5b-46c8-aa9d-1c6cef28e257 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] HTTP exception thrown: Instance 34ecec01-dd25-474d-addd-1d9b8de152b8 could not be found. Aug 31 12:36:46.235970 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-1c88b811-9e5b-46c8-aa9d-1c6cef28e257 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Request method failure captured: Aug 31 12:36:46.235970 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: request: GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 HTTP/1.1 Aug 31 12:36:46.235970 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept: application/json Aug 31 12:36:46.235970 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept-Encoding: identity Aug 31 12:36:46.235970 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Connection: close Aug 31 12:36:46.235970 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Length: 0 Aug 31 12:36:46.235970 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Type: application/json Aug 31 12:36:46.235970 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Host: 10.222.0.79 Aug 31 12:36:46.235970 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Openstack-System-Scope: None Aug 31 12:36:46.235970 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: User-Agent: python-urllib3/1.26.12 Aug 31 12:36:46.235970 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Auth-Token: gAAAAABjD1Q8_fKXu_7R_QGxQKTF7lFiWyT2RAjzIuVPjIM9dyfrljx1xlXnC7qwTfL8uoCLrmDxjoUAGbKrZ1-as7HlKH9zn8Ie9RnJFoQuIgtxkzodw4_WMQMiOoe7YSrL8r3gdFv9pH5SeNHNJOZzft1oVZcsjzrhUw3REkSM22eu5KLeZ3w Aug 31 12:36:46.235970 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Id: None Aug 31 12:36:46.235970 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Name: None Aug 31 12:36:46.235970 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Identity-Status: Confirmed Aug 31 12:36:46.235970 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Is-Admin-Project: True Aug 31 12:36:46.235970 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 12:36:46.235970 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Id: default Aug 31 12:36:46.235970 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Name: Default Aug 31 12:36:46.235970 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Id: 93d78bffa2c740b1aa7e09882a90eb9a Aug 31 12:36:46.235970 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1598873957 Aug 31 12:36:46.235970 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Role: reader,member Aug 31 12:36:46.235970 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Roles: reader,member Aug 31 12:36:46.237692 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/93d78bffa2c740b1aa7e09882a90eb9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_93d78bffa2c740b1aa7e09882a90eb9a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/93d78bffa2c740b1aa7e09882a90eb9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/93d78bffa2c740b1aa7e09882a90eb9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:36:46.237692 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1598873957 Aug 31 12:36:46.237692 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Id: 93d78bffa2c740b1aa7e09882a90eb9a Aug 31 12:36:46.237692 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1598873957 Aug 31 12:36:46.237692 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User: tempest-AttachVolumeShelveTestJSON-1598873957-project Aug 31 12:36:46.237692 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Id: default Aug 31 12:36:46.237692 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Name: Default Aug 31 12:36:46.237692 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Id: ee19faf2a2c54b19a9dc01d28f045b3a Aug 31 12:36:46.237692 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1598873957-project Aug 31 12:36:46.237692 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: method: > Aug 31 12:36:46.237692 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: exception: Instance 34ecec01-dd25-474d-addd-1d9b8de152b8 could not be found. Aug 31 12:36:46.237692 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: action_args: {'id': '34ecec01-dd25-474d-addd-1d9b8de152b8'} Aug 31 12:36:46.239054 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:36:46.239054 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:36:46.239054 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:36:46.239054 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:36:46.239054 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:36:46.239054 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:36:46.239054 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:36:46.239054 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:36:46.239054 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:36:46.239054 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:36:46.239054 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34ecec01-dd25-474d-addd-1d9b8de152b8 could not be found. Aug 31 12:36:46.239054 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:36:46.239054 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:36:46.239054 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:36:46.239054 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:36:46.239054 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:36:46.239054 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:36:46.239054 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:36:46.239054 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:36:46.239054 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:36:46.240612 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:36:46.240612 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:36:46.240612 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:36:46.240612 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:36:46.240612 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:36:46.240612 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:36:46.240612 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:36:46.240612 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34ecec01-dd25-474d-addd-1d9b8de152b8 could not be found. Aug 31 12:36:46.240612 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:36:46.240612 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:36:46.240612 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:36:46.240612 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:36:46.240612 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:36:46.240612 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:36:46.240612 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:36:46.240612 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:36:46.240612 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34ecec01-dd25-474d-addd-1d9b8de152b8 could not be found. Aug 31 12:36:46.240612 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:36:46.243147 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-1c88b811-9e5b-46c8-aa9d-1c6cef28e257 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] Returning 404 to user: Instance 34ecec01-dd25-474d-addd-1d9b8de152b8 could not be found. {{(pid=120749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:36:46.243147 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-1c88b811-9e5b-46c8-aa9d-1c6cef28e257 tempest-AttachVolumeShelveTestJSON-1598873957 tempest-AttachVolumeShelveTestJSON-1598873957-project] 10.222.0.79 "GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8" status: 404 len: 111 microversion: 2.20 time: 0.032727 Aug 31 12:36:46.243147 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 356/705] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:46 2022] GET /compute/v2.1/servers/34ecec01-dd25-474d-addd-1d9b8de152b8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 12:37:07.455199 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-4f76f3af-709d-411c-972d-d68bcdc65b4c tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-296039641", "imageRef": "2aaf4ebd-395b-468e-bb6b-c663d01edea0", "flavorRef": "452", "networks": [{"uuid": "7d7c4a9e-151b-4400-823e-37aa38537914"}]}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:37:07.464484 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_api:SELECT=1 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:07.515609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.network.neutron [None req-4f76f3af-709d-411c-972d-d68bcdc65b4c tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] validate_networks() for [('7d7c4a9e-151b-4400-823e-37aa38537914', None, None, None, None, None)] {{(pid=120750) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:37:07.922189 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-4f76f3af-709d-411c-972d-d68bcdc65b4c tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Flavor limits 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:37:07.922667 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-4f76f3af-709d-411c-972d-d68bcdc65b4c tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Image limits 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:37:07.923494 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-4f76f3af-709d-411c-972d-d68bcdc65b4c tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Flavor pref 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:37:07.923904 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-4f76f3af-709d-411c-972d-d68bcdc65b4c tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Image pref 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:37:07.924312 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-4f76f3af-709d-411c-972d-d68bcdc65b4c tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:37:07.934170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4f76f3af-709d-411c-972d-d68bcdc65b4c tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:07.934511 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4f76f3af-709d-411c-972d-d68bcdc65b4c tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:07.934976 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4f76f3af-709d-411c-972d-d68bcdc65b4c tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:07.935698 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4f76f3af-709d-411c-972d-d68bcdc65b4c tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:07.936150 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4f76f3af-709d-411c-972d-d68bcdc65b4c tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:07.936568 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4f76f3af-709d-411c-972d-d68bcdc65b4c tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:07.953974 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-4f76f3af-709d-411c-972d-d68bcdc65b4c tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Getting quotas for project 812b75d0fa3241d38b2727efe253ca20. Resources: {'cores', 'ram', 'instances'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:37:07.958037 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-4f76f3af-709d-411c-972d-d68bcdc65b4c tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Getting quotas for user c4fb81a9221d435a8d9e38ab138cad4a and project 812b75d0fa3241d38b2727efe253ca20. Resources: {'cores', 'ram', 'instances'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:37:07.970104 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-4f76f3af-709d-411c-972d-d68bcdc65b4c tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Going to run 1 instances... {{(pid=120750) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:37:07.972430 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-4f76f3af-709d-411c-972d-d68bcdc65b4c tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: 87f1b460-e745-4493-b38a-8a6ae3780e72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aaf4ebd-395b-468e-bb6b-c663d01edea0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120750) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:37:08.025515 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-4f76f3af-709d-411c-972d-d68bcdc65b4c tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.576290 Aug 31 12:37:08.026181 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 350/706] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 31 12:37:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:37:08.040727 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-3e1426af-0194-47c2-9dea-dfa068cf0e23 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:08.040727 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-3e1426af-0194-47c2-9dea-dfa068cf0e23 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: 87f1b460-e745-4493-b38a-8a6ae3780e72] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:08.057555 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:08.058946 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=5 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:08.122652 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-3e1426af-0194-47c2-9dea-dfa068cf0e23 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:08.130221 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-3e1426af-0194-47c2-9dea-dfa068cf0e23 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72" status: 200 len: 1218 microversion: 2.1 time: 0.096969 Aug 31 12:37:08.131038 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 357/707] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:08 2022] GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:09.153495 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-d5a9b1ae-f05b-4ea3-8314-423e33cdba96 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:09.154421 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-d5a9b1ae-f05b-4ea3-8314-423e33cdba96 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: 87f1b460-e745-4493-b38a-8a6ae3780e72] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:09.160976 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d5a9b1ae-f05b-4ea3-8314-423e33cdba96 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:09.161642 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d5a9b1ae-f05b-4ea3-8314-423e33cdba96 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:09.166058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d5a9b1ae-f05b-4ea3-8314-423e33cdba96 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:09.166058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d5a9b1ae-f05b-4ea3-8314-423e33cdba96 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:09.166058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d5a9b1ae-f05b-4ea3-8314-423e33cdba96 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:09.166058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d5a9b1ae-f05b-4ea3-8314-423e33cdba96 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:09.249936 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-d5a9b1ae-f05b-4ea3-8314-423e33cdba96 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:09.257834 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-d5a9b1ae-f05b-4ea3-8314-423e33cdba96 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72" status: 200 len: 1270 microversion: 2.1 time: 0.109111 Aug 31 12:37:09.259010 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 351/708] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:09 2022] GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72 => generated 1270 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:10.281342 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-bb0e6131-ace6-4b90-83c5-c2d6be4a2628 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:10.281971 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-bb0e6131-ace6-4b90-83c5-c2d6be4a2628 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: 87f1b460-e745-4493-b38a-8a6ae3780e72] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:10.289893 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bb0e6131-ace6-4b90-83c5-c2d6be4a2628 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:10.291166 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bb0e6131-ace6-4b90-83c5-c2d6be4a2628 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:10.291834 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bb0e6131-ace6-4b90-83c5-c2d6be4a2628 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:10.292563 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bb0e6131-ace6-4b90-83c5-c2d6be4a2628 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:10.293062 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bb0e6131-ace6-4b90-83c5-c2d6be4a2628 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:10.293494 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bb0e6131-ace6-4b90-83c5-c2d6be4a2628 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:10.430605 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-bb0e6131-ace6-4b90-83c5-c2d6be4a2628 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:10.438310 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-bb0e6131-ace6-4b90-83c5-c2d6be4a2628 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72" status: 200 len: 1318 microversion: 2.1 time: 0.160904 Aug 31 12:37:10.438903 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 358/709] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:10 2022] GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:11.460070 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-7c122d66-1486-47fb-8d81-d4443af417d3 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:11.460659 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-7c122d66-1486-47fb-8d81-d4443af417d3 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: 87f1b460-e745-4493-b38a-8a6ae3780e72] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:11.467705 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7c122d66-1486-47fb-8d81-d4443af417d3 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:11.468190 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7c122d66-1486-47fb-8d81-d4443af417d3 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:11.468650 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7c122d66-1486-47fb-8d81-d4443af417d3 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:11.469349 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7c122d66-1486-47fb-8d81-d4443af417d3 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:11.469801 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7c122d66-1486-47fb-8d81-d4443af417d3 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:11.470218 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7c122d66-1486-47fb-8d81-d4443af417d3 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:11.657740 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-7c122d66-1486-47fb-8d81-d4443af417d3 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:11.666800 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-7c122d66-1486-47fb-8d81-d4443af417d3 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72" status: 200 len: 1318 microversion: 2.1 time: 0.209730 Aug 31 12:37:11.667673 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 352/710] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:11 2022] GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:12.401827 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-350d000c-28a1-417e-b8ad-c27638308c1a req-19f649af-cb6e-4b56-a573-47349e3d4802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87f1b460-e745-4493-b38a-8a6ae3780e72", "tag": "f31716a0-6378-4919-bbe4-3fed724b2f58"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:37:12.411727 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-350d000c-28a1-417e-b8ad-c27638308c1a req-19f649af-cb6e-4b56-a573-47349e3d4802 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:12.412283 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-350d000c-28a1-417e-b8ad-c27638308c1a req-19f649af-cb6e-4b56-a573-47349e3d4802 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:12.412712 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-350d000c-28a1-417e-b8ad-c27638308c1a req-19f649af-cb6e-4b56-a573-47349e3d4802 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:12.423851 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-350d000c-28a1-417e-b8ad-c27638308c1a req-19f649af-cb6e-4b56-a573-47349e3d4802 service nova] Creating event network-changed:f31716a0-6378-4919-bbe4-3fed724b2f58 for instance 87f1b460-e745-4493-b38a-8a6ae3780e72 on hv-cinder-85528 Aug 31 12:37:12.428701 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-350d000c-28a1-417e-b8ad-c27638308c1a req-19f649af-cb6e-4b56-a573-47349e3d4802 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031379 Aug 31 12:37:12.429301 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 359/711] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:37:12.687956 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-e0341291-f274-47fb-8cee-814934ed5c95 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:12.688560 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-e0341291-f274-47fb-8cee-814934ed5c95 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: 87f1b460-e745-4493-b38a-8a6ae3780e72] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:12.694932 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e0341291-f274-47fb-8cee-814934ed5c95 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:12.695417 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e0341291-f274-47fb-8cee-814934ed5c95 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:12.695849 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e0341291-f274-47fb-8cee-814934ed5c95 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:12.696749 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e0341291-f274-47fb-8cee-814934ed5c95 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:12.696993 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e0341291-f274-47fb-8cee-814934ed5c95 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:12.698003 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e0341291-f274-47fb-8cee-814934ed5c95 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:12.888485 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-e0341291-f274-47fb-8cee-814934ed5c95 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:12.896702 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-e0341291-f274-47fb-8cee-814934ed5c95 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72" status: 200 len: 1318 microversion: 2.1 time: 0.212500 Aug 31 12:37:12.897282 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 353/712] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:12 2022] GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:13.920275 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-46bc9ea6-7790-499d-8848-3acdc3dccf6b tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:13.920889 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-46bc9ea6-7790-499d-8848-3acdc3dccf6b tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: 87f1b460-e745-4493-b38a-8a6ae3780e72] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:13.927285 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-46bc9ea6-7790-499d-8848-3acdc3dccf6b tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:13.927772 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-46bc9ea6-7790-499d-8848-3acdc3dccf6b tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:13.928208 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-46bc9ea6-7790-499d-8848-3acdc3dccf6b tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:13.928942 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-46bc9ea6-7790-499d-8848-3acdc3dccf6b tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:13.929396 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-46bc9ea6-7790-499d-8848-3acdc3dccf6b tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:13.929822 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-46bc9ea6-7790-499d-8848-3acdc3dccf6b tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:14.061687 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-46bc9ea6-7790-499d-8848-3acdc3dccf6b tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:14.069458 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-46bc9ea6-7790-499d-8848-3acdc3dccf6b tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72" status: 200 len: 1318 microversion: 2.1 time: 0.155241 Aug 31 12:37:14.070028 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 360/713] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:13 2022] GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:15.092044 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-3cbd3363-d3bc-4cd4-a091-026de8719f78 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:15.092687 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-3cbd3363-d3bc-4cd4-a091-026de8719f78 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: 87f1b460-e745-4493-b38a-8a6ae3780e72] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:15.099270 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3cbd3363-d3bc-4cd4-a091-026de8719f78 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:15.099755 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3cbd3363-d3bc-4cd4-a091-026de8719f78 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:15.100187 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3cbd3363-d3bc-4cd4-a091-026de8719f78 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:15.100882 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3cbd3363-d3bc-4cd4-a091-026de8719f78 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:15.101332 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3cbd3363-d3bc-4cd4-a091-026de8719f78 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:15.101749 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3cbd3363-d3bc-4cd4-a091-026de8719f78 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:15.246357 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-3cbd3363-d3bc-4cd4-a091-026de8719f78 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:15.254150 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-3cbd3363-d3bc-4cd4-a091-026de8719f78 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72" status: 200 len: 1318 microversion: 2.1 time: 0.166759 Aug 31 12:37:15.254744 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 354/714] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:15 2022] GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:16.276403 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-d5bf1abb-44ba-4de5-b8c9-60e5f44f7779 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:16.277019 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-d5bf1abb-44ba-4de5-b8c9-60e5f44f7779 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: 87f1b460-e745-4493-b38a-8a6ae3780e72] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:16.283712 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d5bf1abb-44ba-4de5-b8c9-60e5f44f7779 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:16.284208 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d5bf1abb-44ba-4de5-b8c9-60e5f44f7779 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:16.284674 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d5bf1abb-44ba-4de5-b8c9-60e5f44f7779 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:16.285391 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d5bf1abb-44ba-4de5-b8c9-60e5f44f7779 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:16.285846 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d5bf1abb-44ba-4de5-b8c9-60e5f44f7779 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:16.286270 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d5bf1abb-44ba-4de5-b8c9-60e5f44f7779 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:16.435152 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-d5bf1abb-44ba-4de5-b8c9-60e5f44f7779 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:16.443289 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-d5bf1abb-44ba-4de5-b8c9-60e5f44f7779 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72" status: 200 len: 1318 microversion: 2.1 time: 0.171268 Aug 31 12:37:16.443881 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 361/715] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:16 2022] GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:17.465212 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-cade67b0-2b56-40e4-b2f4-0ceeeee4184f tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:17.465812 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-cade67b0-2b56-40e4-b2f4-0ceeeee4184f tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: 87f1b460-e745-4493-b38a-8a6ae3780e72] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:17.472214 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cade67b0-2b56-40e4-b2f4-0ceeeee4184f tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:17.472686 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cade67b0-2b56-40e4-b2f4-0ceeeee4184f tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:17.473110 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cade67b0-2b56-40e4-b2f4-0ceeeee4184f tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:17.473781 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cade67b0-2b56-40e4-b2f4-0ceeeee4184f tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:17.474226 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cade67b0-2b56-40e4-b2f4-0ceeeee4184f tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:17.474640 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-cade67b0-2b56-40e4-b2f4-0ceeeee4184f tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:17.606775 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-cade67b0-2b56-40e4-b2f4-0ceeeee4184f tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:17.615231 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-cade67b0-2b56-40e4-b2f4-0ceeeee4184f tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72" status: 200 len: 1318 microversion: 2.1 time: 0.153424 Aug 31 12:37:17.615924 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 355/716] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:17 2022] GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:18.504590 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-ebee99b5-dc3a-441e-9749-fef749ddee19 req-879591e8-dcd0-4abb-a719-61db2856282e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87f1b460-e745-4493-b38a-8a6ae3780e72", "name": "network-vif-plugged", "status": "completed", "tag": "f31716a0-6378-4919-bbe4-3fed724b2f58"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:37:18.510176 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=2 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:18.516830 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-ebee99b5-dc3a-441e-9749-fef749ddee19 req-879591e8-dcd0-4abb-a719-61db2856282e service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:18.517306 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-ebee99b5-dc3a-441e-9749-fef749ddee19 req-879591e8-dcd0-4abb-a719-61db2856282e service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:18.517757 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-ebee99b5-dc3a-441e-9749-fef749ddee19 req-879591e8-dcd0-4abb-a719-61db2856282e service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:18.529648 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-ebee99b5-dc3a-441e-9749-fef749ddee19 req-879591e8-dcd0-4abb-a719-61db2856282e service nova] Creating event network-vif-plugged:f31716a0-6378-4919-bbe4-3fed724b2f58 for instance 87f1b460-e745-4493-b38a-8a6ae3780e72 on hv-cinder-85528 Aug 31 12:37:18.536119 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-ebee99b5-dc3a-441e-9749-fef749ddee19 req-879591e8-dcd0-4abb-a719-61db2856282e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035245 Aug 31 12:37:18.536773 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 362/717] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:37:18.640422 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-2b9d7803-8c10-4653-bd46-a52488ff4d68 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:18.642061 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-2b9d7803-8c10-4653-bd46-a52488ff4d68 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: 87f1b460-e745-4493-b38a-8a6ae3780e72] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:18.646129 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell0:SELECT=2 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:18.647176 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell0:SELECT=6 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:18.656444 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2b9d7803-8c10-4653-bd46-a52488ff4d68 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:18.657307 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2b9d7803-8c10-4653-bd46-a52488ff4d68 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:18.658110 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2b9d7803-8c10-4653-bd46-a52488ff4d68 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:18.659451 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2b9d7803-8c10-4653-bd46-a52488ff4d68 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:18.660291 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2b9d7803-8c10-4653-bd46-a52488ff4d68 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:18.661061 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2b9d7803-8c10-4653-bd46-a52488ff4d68 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:18.871848 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-2b9d7803-8c10-4653-bd46-a52488ff4d68 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:18.879429 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-2b9d7803-8c10-4653-bd46-a52488ff4d68 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72" status: 200 len: 1318 microversion: 2.1 time: 0.245517 Aug 31 12:37:18.880172 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 356/718] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:18 2022] GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:19.903403 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-14c39f3b-4604-4344-87a4-c637807c1a5e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:19.904364 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-14c39f3b-4604-4344-87a4-c637807c1a5e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: 87f1b460-e745-4493-b38a-8a6ae3780e72] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:19.911545 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-14c39f3b-4604-4344-87a4-c637807c1a5e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:19.912051 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-14c39f3b-4604-4344-87a4-c637807c1a5e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:19.912510 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-14c39f3b-4604-4344-87a4-c637807c1a5e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:19.913305 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-14c39f3b-4604-4344-87a4-c637807c1a5e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:19.913756 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-14c39f3b-4604-4344-87a4-c637807c1a5e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:19.914260 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-14c39f3b-4604-4344-87a4-c637807c1a5e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:20.059113 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-14c39f3b-4604-4344-87a4-c637807c1a5e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:20.066982 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-14c39f3b-4604-4344-87a4-c637807c1a5e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72" status: 200 len: 1318 microversion: 2.1 time: 0.169845 Aug 31 12:37:20.067565 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 363/719] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:19 2022] GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:21.089583 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-6936d625-dacb-4cff-8169-15eb3d2f084e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:21.090175 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-6936d625-dacb-4cff-8169-15eb3d2f084e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: 87f1b460-e745-4493-b38a-8a6ae3780e72] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:21.096916 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6936d625-dacb-4cff-8169-15eb3d2f084e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:21.097395 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6936d625-dacb-4cff-8169-15eb3d2f084e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:21.097822 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6936d625-dacb-4cff-8169-15eb3d2f084e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:21.098514 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6936d625-dacb-4cff-8169-15eb3d2f084e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:21.099036 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6936d625-dacb-4cff-8169-15eb3d2f084e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:21.099457 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6936d625-dacb-4cff-8169-15eb3d2f084e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:21.240255 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-6936d625-dacb-4cff-8169-15eb3d2f084e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:21.248213 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-6936d625-dacb-4cff-8169-15eb3d2f084e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72" status: 200 len: 1505 microversion: 2.1 time: 0.163450 Aug 31 12:37:21.248767 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 357/720] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:21 2022] GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72 => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:26.491920 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-a09c85d8-e8ef-43b8-a2c5-3abc9cfc553b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:26.492530 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-a09c85d8-e8ef-43b8-a2c5-3abc9cfc553b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d2bf3eb8-923d-4d45-be04-9bbb01430123] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:26.499351 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a09c85d8-e8ef-43b8-a2c5-3abc9cfc553b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:26.499840 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a09c85d8-e8ef-43b8-a2c5-3abc9cfc553b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:26.500287 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a09c85d8-e8ef-43b8-a2c5-3abc9cfc553b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:26.500963 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a09c85d8-e8ef-43b8-a2c5-3abc9cfc553b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:26.501414 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a09c85d8-e8ef-43b8-a2c5-3abc9cfc553b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:26.501837 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a09c85d8-e8ef-43b8-a2c5-3abc9cfc553b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:26.527271 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-a09c85d8-e8ef-43b8-a2c5-3abc9cfc553b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123/ips" status: 200 len: 149 microversion: 2.1 time: 0.039594 Aug 31 12:37:26.527841 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 364/721] 10.222.0.79 () {58 vars in 1248 bytes} [Wed Aug 31 12:37:26 2022] GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:37:26.539446 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-be28d9fe-3923-4ffa-983f-efa4e2d85a83 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0e00007-bb8c-4bab-b103-bb5dc93a9df3"}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:37:26.542406 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-be28d9fe-3923-4ffa-983f-efa4e2d85a83 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d2bf3eb8-923d-4d45-be04-9bbb01430123] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:26.548838 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-be28d9fe-3923-4ffa-983f-efa4e2d85a83 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:26.549315 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-be28d9fe-3923-4ffa-983f-efa4e2d85a83 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:26.549744 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-be28d9fe-3923-4ffa-983f-efa4e2d85a83 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:26.550422 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-be28d9fe-3923-4ffa-983f-efa4e2d85a83 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:26.550887 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-be28d9fe-3923-4ffa-983f-efa4e2d85a83 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:26.551312 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-be28d9fe-3923-4ffa-983f-efa4e2d85a83 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:26.637752 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-be28d9fe-3923-4ffa-983f-efa4e2d85a83 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] HTTP exception thrown: Invalid volume: volume a0e00007-bb8c-4bab-b103-bb5dc93a9df3 is already attached to instances: d921f6f0-2017-4941-8d52-1abe875c6ebe Aug 31 12:37:26.640113 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-be28d9fe-3923-4ffa-983f-efa4e2d85a83 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Request method failure captured: Aug 31 12:37:26.640113 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: POST /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123/os-volume_attachments HTTP/1.1 Aug 31 12:37:26.640113 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:37:26.640113 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:37:26.640113 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:37:26.640113 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 74 Aug 31 12:37:26.640113 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:37:26.640113 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:37:26.640113 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:37:26.640113 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:37:26.640113 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1WA4hDI1B8mwzFgw9UjF0bHYxh-W0PYTg_8OeWEX87GiaZzZhuOr6eQtJ_dbJdWxGbnvcJjpQHDWtPVijl1hs_KhQSiluyTrf3Gs1WSceTlpv-MeDVwBqGReHlFVzM62nzVejCXNhnFRVyOFKPna_2ISD5If38YADpegsr8a3mNzBI Aug 31 12:37:26.640113 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:37:26.640113 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:37:26.640113 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:37:26.640113 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:37:26.640113 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:37:26.640113 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:37:26.640113 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: 8f6da846ab4f45a6ac4b2e34bf52abfc Aug 31 12:37:26.640113 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:37:26.640113 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:37:26.640113 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:37:26.642135 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8f6da846ab4f45a6ac4b2e34bf52abfc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:37:26.642135 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:37:26.642135 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: 8f6da846ab4f45a6ac4b2e34bf52abfc Aug 31 12:37:26.642135 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:37:26.642135 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-AttachVolumeNegativeTest-2001270308-project Aug 31 12:37:26.642135 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:37:26.642135 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:37:26.642135 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: d277532df42244c693b5e51e9fd0c459 Aug 31 12:37:26.642135 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-AttachVolumeNegativeTest-2001270308-project Aug 31 12:37:26.642135 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Aug 31 12:37:26.642135 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {"volumeAttachment": {"volumeId": "a0e00007-bb8c-4bab-b103-bb5dc93a9df3"}} Aug 31 12:37:26.642135 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:37:26.643045 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Invalid volume: volume a0e00007-bb8c-4bab-b103-bb5dc93a9df3 is already attached to instances: d921f6f0-2017-4941-8d52-1abe875c6ebe Aug 31 12:37:26.643045 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'server_id': 'd2bf3eb8-923d-4d45-be04-9bbb01430123', 'body': {'volumeAttachment': {'volumeId': 'a0e00007-bb8c-4bab-b103-bb5dc93a9df3'}}} Aug 31 12:37:26.643045 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:37:26.643045 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:37:26.643045 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 12:37:26.643045 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 12:37:26.643045 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 12:37:26.643045 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 12:37:26.643045 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 12:37:26.643045 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 12:37:26.643045 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 12:37:26.643045 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 12:37:26.643045 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 12:37:26.643045 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 12:37:26.643045 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a0e00007-bb8c-4bab-b103-bb5dc93a9df3 is already attached to instances: d921f6f0-2017-4941-8d52-1abe875c6ebe Aug 31 12:37:26.643045 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:37:26.643045 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:37:26.643045 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:37:26.643045 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:37:26.644360 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:37:26.644360 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:37:26.644360 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:37:26.644360 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:37:26.644360 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:37:26.644360 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:37:26.644360 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 12:37:26.644360 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 12:37:26.644360 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 12:37:26.644360 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 12:37:26.644360 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 12:37:26.644360 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 12:37:26.644360 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 12:37:26.644360 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 12:37:26.644360 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a0e00007-bb8c-4bab-b103-bb5dc93a9df3 is already attached to instances: d921f6f0-2017-4941-8d52-1abe875c6ebe Aug 31 12:37:26.644360 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:37:26.644360 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:37:26.644360 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:37:26.644360 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:37:26.644360 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:37:26.645660 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:37:26.645660 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:37:26.645660 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:37:26.645660 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a0e00007-bb8c-4bab-b103-bb5dc93a9df3 is already attached to instances: d921f6f0-2017-4941-8d52-1abe875c6ebe Aug 31 12:37:26.645660 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:37:26.645660 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-be28d9fe-3923-4ffa-983f-efa4e2d85a83 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Returning 400 to user: Invalid volume: volume a0e00007-bb8c-4bab-b103-bb5dc93a9df3 is already attached to instances: d921f6f0-2017-4941-8d52-1abe875c6ebe {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:37:26.645660 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-be28d9fe-3923-4ffa-983f-efa4e2d85a83 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "POST /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106466 Aug 31 12:37:26.645660 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 358/722] 10.222.0.79 () {60 vars in 1323 bytes} [Wed Aug 31 12:37:26 2022] POST /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 12:37:26.651920 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-6e6766a6-efc0-4a43-9a45-146c4bd2811b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:26.652405 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-6e6766a6-efc0-4a43-9a45-146c4bd2811b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d2bf3eb8-923d-4d45-be04-9bbb01430123] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:26.658317 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6e6766a6-efc0-4a43-9a45-146c4bd2811b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:26.658798 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6e6766a6-efc0-4a43-9a45-146c4bd2811b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:26.659259 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6e6766a6-efc0-4a43-9a45-146c4bd2811b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:26.659933 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6e6766a6-efc0-4a43-9a45-146c4bd2811b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:26.660383 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6e6766a6-efc0-4a43-9a45-146c4bd2811b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:26.660804 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6e6766a6-efc0-4a43-9a45-146c4bd2811b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:26.688938 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-6e6766a6-efc0-4a43-9a45-146c4bd2811b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d2bf3eb8-923d-4d45-be04-9bbb01430123] Going to try to terminate instance {{(pid=120749) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:37:26.774407 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-6e6766a6-efc0-4a43-9a45-146c4bd2811b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123" status: 204 len: 0 microversion: 2.1 time: 0.126156 Aug 31 12:37:26.775828 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 365/723] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 31 12:37:26 2022] DELETE /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:37:26.783729 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-302f489f-c9cd-4e6e-b992-316fe27bf919 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:26.784522 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-302f489f-c9cd-4e6e-b992-316fe27bf919 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d2bf3eb8-923d-4d45-be04-9bbb01430123] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:26.792994 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-302f489f-c9cd-4e6e-b992-316fe27bf919 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:26.793491 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-302f489f-c9cd-4e6e-b992-316fe27bf919 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:26.793912 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-302f489f-c9cd-4e6e-b992-316fe27bf919 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:26.794601 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-302f489f-c9cd-4e6e-b992-316fe27bf919 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:26.795144 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-302f489f-c9cd-4e6e-b992-316fe27bf919 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:26.795578 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-302f489f-c9cd-4e6e-b992-316fe27bf919 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:26.930823 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-302f489f-c9cd-4e6e-b992-316fe27bf919 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:26.939261 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-302f489f-c9cd-4e6e-b992-316fe27bf919 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123" status: 200 len: 1680 microversion: 2.1 time: 0.159630 Aug 31 12:37:26.939818 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 359/724] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:26 2022] GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:27.961450 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-c66bf2f3-0122-4daf-82d4-a2f1c97820c7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:27.962063 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-c66bf2f3-0122-4daf-82d4-a2f1c97820c7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d2bf3eb8-923d-4d45-be04-9bbb01430123] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:27.968566 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c66bf2f3-0122-4daf-82d4-a2f1c97820c7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:27.969059 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c66bf2f3-0122-4daf-82d4-a2f1c97820c7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:27.969499 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c66bf2f3-0122-4daf-82d4-a2f1c97820c7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:27.970188 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c66bf2f3-0122-4daf-82d4-a2f1c97820c7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:27.970647 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c66bf2f3-0122-4daf-82d4-a2f1c97820c7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:27.971102 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c66bf2f3-0122-4daf-82d4-a2f1c97820c7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:28.115623 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-c66bf2f3-0122-4daf-82d4-a2f1c97820c7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:28.123454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-c66bf2f3-0122-4daf-82d4-a2f1c97820c7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123" status: 200 len: 1680 microversion: 2.1 time: 0.166329 Aug 31 12:37:28.124009 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 366/725] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:27 2022] GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:29.145830 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-efbd7b42-22db-453b-a6ee-6e7780c64529 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:29.147235 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-efbd7b42-22db-453b-a6ee-6e7780c64529 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d2bf3eb8-923d-4d45-be04-9bbb01430123] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:29.155041 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-efbd7b42-22db-453b-a6ee-6e7780c64529 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:29.155660 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-efbd7b42-22db-453b-a6ee-6e7780c64529 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:29.156809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-efbd7b42-22db-453b-a6ee-6e7780c64529 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:29.157745 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-efbd7b42-22db-453b-a6ee-6e7780c64529 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:29.161379 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-efbd7b42-22db-453b-a6ee-6e7780c64529 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:29.162095 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-efbd7b42-22db-453b-a6ee-6e7780c64529 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:29.288930 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-3156284f-6c96-4b84-9b6f-8f14a99743ac req-271ae6a8-e1e7-4cb8-a727-f7c2ea83a8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2bf3eb8-923d-4d45-be04-9bbb01430123", "name": "network-vif-deleted", "tag": "2ab2322c-99cd-42b9-8261-6f9850b02e6d"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:37:29.312688 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-efbd7b42-22db-453b-a6ee-6e7780c64529 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:29.314090 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-3156284f-6c96-4b84-9b6f-8f14a99743ac req-271ae6a8-e1e7-4cb8-a727-f7c2ea83a8f4 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:29.314757 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-3156284f-6c96-4b84-9b6f-8f14a99743ac req-271ae6a8-e1e7-4cb8-a727-f7c2ea83a8f4 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:29.315484 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-3156284f-6c96-4b84-9b6f-8f14a99743ac req-271ae6a8-e1e7-4cb8-a727-f7c2ea83a8f4 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:29.324889 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-efbd7b42-22db-453b-a6ee-6e7780c64529 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123" status: 200 len: 1614 microversion: 2.1 time: 0.183136 Aug 31 12:37:29.325474 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 360/726] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:29 2022] GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123 => generated 1614 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:29.339055 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-3156284f-6c96-4b84-9b6f-8f14a99743ac req-271ae6a8-e1e7-4cb8-a727-f7c2ea83a8f4 service nova] Creating event network-vif-deleted:2ab2322c-99cd-42b9-8261-6f9850b02e6d for instance d2bf3eb8-923d-4d45-be04-9bbb01430123 on hv-cinder-85528 Aug 31 12:37:29.360211 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-3156284f-6c96-4b84-9b6f-8f14a99743ac req-271ae6a8-e1e7-4cb8-a727-f7c2ea83a8f4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075977 Aug 31 12:37:29.361097 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 367/727] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:37:30.345897 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-a94f3db4-493c-4e16-8688-9278024beea8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:30.346660 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-a94f3db4-493c-4e16-8688-9278024beea8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d2bf3eb8-923d-4d45-be04-9bbb01430123] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:30.359268 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a94f3db4-493c-4e16-8688-9278024beea8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:30.359705 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a94f3db4-493c-4e16-8688-9278024beea8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:30.360132 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a94f3db4-493c-4e16-8688-9278024beea8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:30.361150 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a94f3db4-493c-4e16-8688-9278024beea8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:30.361834 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a94f3db4-493c-4e16-8688-9278024beea8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:30.362413 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a94f3db4-493c-4e16-8688-9278024beea8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:30.381616 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-a94f3db4-493c-4e16-8688-9278024beea8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] HTTP exception thrown: Instance d2bf3eb8-923d-4d45-be04-9bbb01430123 could not be found. Aug 31 12:37:30.383587 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-a94f3db4-493c-4e16-8688-9278024beea8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Request method failure captured: Aug 31 12:37:30.383587 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123 HTTP/1.1 Aug 31 12:37:30.383587 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:37:30.383587 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:37:30.383587 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:37:30.383587 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 0 Aug 31 12:37:30.383587 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:37:30.383587 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:37:30.383587 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:37:30.383587 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:37:30.383587 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1WA4hDI1B8mwzFgw9UjF0bHYxh-W0PYTg_8OeWEX87GiaZzZhuOr6eQtJ_dbJdWxGbnvcJjpQHDWtPVijl1hs_KhQSiluyTrf3Gs1WSceTlpv-MeDVwBqGReHlFVzM62nzVejCXNhnFRVyOFKPna_2ISD5If38YADpegsr8a3mNzBI Aug 31 12:37:30.383587 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:37:30.383587 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:37:30.383587 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:37:30.383587 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:37:30.383587 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:37:30.383587 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:37:30.383587 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: 8f6da846ab4f45a6ac4b2e34bf52abfc Aug 31 12:37:30.383587 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:37:30.383587 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:37:30.383587 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:37:30.385283 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8f6da846ab4f45a6ac4b2e34bf52abfc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:37:30.385283 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:37:30.385283 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: 8f6da846ab4f45a6ac4b2e34bf52abfc Aug 31 12:37:30.385283 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:37:30.385283 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-AttachVolumeNegativeTest-2001270308-project Aug 31 12:37:30.385283 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:37:30.385283 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:37:30.385283 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: d277532df42244c693b5e51e9fd0c459 Aug 31 12:37:30.385283 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-AttachVolumeNegativeTest-2001270308-project Aug 31 12:37:30.385283 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:37:30.385283 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Instance d2bf3eb8-923d-4d45-be04-9bbb01430123 could not be found. Aug 31 12:37:30.385283 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'id': 'd2bf3eb8-923d-4d45-be04-9bbb01430123'} Aug 31 12:37:30.386227 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:37:30.386227 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:37:30.386227 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:37:30.386227 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:37:30.386227 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:37:30.386227 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:37:30.386227 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:37:30.386227 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:37:30.386227 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:37:30.386227 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:37:30.386227 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2bf3eb8-923d-4d45-be04-9bbb01430123 could not be found. Aug 31 12:37:30.386227 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:37:30.386227 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:37:30.386227 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:37:30.386227 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:37:30.386227 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:37:30.386227 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:37:30.386227 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:37:30.386227 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:37:30.386227 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:37:30.387880 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:37:30.387880 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:37:30.387880 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:37:30.387880 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:37:30.387880 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:37:30.387880 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:37:30.387880 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:37:30.387880 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2bf3eb8-923d-4d45-be04-9bbb01430123 could not be found. Aug 31 12:37:30.387880 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:37:30.387880 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:37:30.387880 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:37:30.387880 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:37:30.387880 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:37:30.387880 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:37:30.387880 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:37:30.387880 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:37:30.387880 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2bf3eb8-923d-4d45-be04-9bbb01430123 could not be found. Aug 31 12:37:30.387880 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:37:30.389276 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-a94f3db4-493c-4e16-8688-9278024beea8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Returning 404 to user: Instance d2bf3eb8-923d-4d45-be04-9bbb01430123 could not be found. {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:37:30.389276 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-a94f3db4-493c-4e16-8688-9278024beea8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123" status: 404 len: 111 microversion: 2.1 time: 0.047441 Aug 31 12:37:30.389716 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 361/728] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:30 2022] GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:37:30.399224 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-6e759ab0-97ea-46ad-ac07-38e03164c7f0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '.version_select at 0x7f8d16f28af0>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:30.420879 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-6e759ab0-97ea-46ad-ac07-38e03164c7f0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1229571913" status: 202 len: 0 microversion: 2.1 time: 0.026241 Aug 31 12:37:30.422132 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 368/729] 10.222.0.79 () {58 vars in 1221 bytes} [Wed Aug 31 12:37:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1229571913 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:37:31.205685 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-47ce0f9e-9a8f-4c83-8ff4-d8eb0336601a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:31.206450 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-47ce0f9e-9a8f-4c83-8ff4-d8eb0336601a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d921f6f0-2017-4941-8d52-1abe875c6ebe] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:31.213546 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-47ce0f9e-9a8f-4c83-8ff4-d8eb0336601a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:31.214482 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-47ce0f9e-9a8f-4c83-8ff4-d8eb0336601a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:31.214956 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-47ce0f9e-9a8f-4c83-8ff4-d8eb0336601a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:31.215850 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-47ce0f9e-9a8f-4c83-8ff4-d8eb0336601a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:31.216478 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-47ce0f9e-9a8f-4c83-8ff4-d8eb0336601a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:31.217084 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-47ce0f9e-9a8f-4c83-8ff4-d8eb0336601a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:31.324991 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.objects.instance [None req-47ce0f9e-9a8f-4c83-8ff4-d8eb0336601a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lazy-loading 'services' on Instance uuid d921f6f0-2017-4941-8d52-1abe875c6ebe {{(pid=120750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:37:31.412454 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-47ce0f9e-9a8f-4c83-8ff4-d8eb0336601a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe/os-volume_attachments/a0e00007-bb8c-4bab-b103-bb5dc93a9df3" status: 202 len: 0 microversion: 2.1 time: 0.210823 Aug 31 12:37:31.417574 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 362/730] 10.222.0.79 () {58 vars in 1416 bytes} [Wed Aug 31 12:37:31 2022] DELETE /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe/os-volume_attachments/a0e00007-bb8c-4bab-b103-bb5dc93a9df3 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 12:37:31.423459 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-645f1c9e-0bad-4983-a4b1-1f18e25643f3 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:31.427279 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-645f1c9e-0bad-4983-a4b1-1f18e25643f3 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d921f6f0-2017-4941-8d52-1abe875c6ebe] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:31.436620 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-645f1c9e-0bad-4983-a4b1-1f18e25643f3 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:31.437623 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-645f1c9e-0bad-4983-a4b1-1f18e25643f3 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:31.438335 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-645f1c9e-0bad-4983-a4b1-1f18e25643f3 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:31.439368 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-645f1c9e-0bad-4983-a4b1-1f18e25643f3 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:31.440099 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-645f1c9e-0bad-4983-a4b1-1f18e25643f3 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:31.440531 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-645f1c9e-0bad-4983-a4b1-1f18e25643f3 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:31.479591 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-645f1c9e-0bad-4983-a4b1-1f18e25643f3 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059984 Aug 31 12:37:31.485688 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 369/731] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 31 12:37:31 2022] GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:37:32.496080 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b7c4ecef-8ef7-4a5e-8e6c-37347c9c206b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:32.498414 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-b7c4ecef-8ef7-4a5e-8e6c-37347c9c206b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d921f6f0-2017-4941-8d52-1abe875c6ebe] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:32.504979 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b7c4ecef-8ef7-4a5e-8e6c-37347c9c206b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:32.505464 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b7c4ecef-8ef7-4a5e-8e6c-37347c9c206b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:32.505893 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b7c4ecef-8ef7-4a5e-8e6c-37347c9c206b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:32.506585 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b7c4ecef-8ef7-4a5e-8e6c-37347c9c206b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:32.507239 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b7c4ecef-8ef7-4a5e-8e6c-37347c9c206b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:32.507657 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b7c4ecef-8ef7-4a5e-8e6c-37347c9c206b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:32.541431 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b7c4ecef-8ef7-4a5e-8e6c-37347c9c206b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050199 Aug 31 12:37:32.542438 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 363/732] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 31 12:37:32 2022] GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 12:37:32.613705 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-5bb60488-07d5-4b1b-b647-36b69c64bbf8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:32.614365 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-5bb60488-07d5-4b1b-b647-36b69c64bbf8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d921f6f0-2017-4941-8d52-1abe875c6ebe] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:32.623468 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5bb60488-07d5-4b1b-b647-36b69c64bbf8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:32.623969 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5bb60488-07d5-4b1b-b647-36b69c64bbf8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:32.624414 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5bb60488-07d5-4b1b-b647-36b69c64bbf8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:32.625120 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5bb60488-07d5-4b1b-b647-36b69c64bbf8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:32.625575 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5bb60488-07d5-4b1b-b647-36b69c64bbf8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:32.626000 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5bb60488-07d5-4b1b-b647-36b69c64bbf8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:32.653802 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-5bb60488-07d5-4b1b-b647-36b69c64bbf8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d921f6f0-2017-4941-8d52-1abe875c6ebe] Going to try to terminate instance {{(pid=120749) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:37:32.738214 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-5bb60488-07d5-4b1b-b647-36b69c64bbf8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe" status: 204 len: 0 microversion: 2.1 time: 0.129178 Aug 31 12:37:32.738924 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 370/733] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 31 12:37:32 2022] DELETE /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:37:32.748134 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-91918992-1b11-46b7-b7f7-76f2763d42a5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:32.749560 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-91918992-1b11-46b7-b7f7-76f2763d42a5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d921f6f0-2017-4941-8d52-1abe875c6ebe] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:32.756011 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-91918992-1b11-46b7-b7f7-76f2763d42a5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:32.756488 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-91918992-1b11-46b7-b7f7-76f2763d42a5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:32.757098 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-91918992-1b11-46b7-b7f7-76f2763d42a5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:32.757793 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-91918992-1b11-46b7-b7f7-76f2763d42a5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:32.758237 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-91918992-1b11-46b7-b7f7-76f2763d42a5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:32.758652 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-91918992-1b11-46b7-b7f7-76f2763d42a5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:32.939555 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-91918992-1b11-46b7-b7f7-76f2763d42a5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:32.948850 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-91918992-1b11-46b7-b7f7-76f2763d42a5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe" status: 200 len: 1681 microversion: 2.1 time: 0.205316 Aug 31 12:37:32.949521 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 364/734] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:32 2022] GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe => generated 1681 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:33.971478 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-8aa64f6a-d532-4bce-8193-6a04c6c50df0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:33.972172 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-8aa64f6a-d532-4bce-8193-6a04c6c50df0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d921f6f0-2017-4941-8d52-1abe875c6ebe] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:33.979375 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8aa64f6a-d532-4bce-8193-6a04c6c50df0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:33.979861 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8aa64f6a-d532-4bce-8193-6a04c6c50df0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:33.980291 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8aa64f6a-d532-4bce-8193-6a04c6c50df0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:33.980996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8aa64f6a-d532-4bce-8193-6a04c6c50df0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:33.981442 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8aa64f6a-d532-4bce-8193-6a04c6c50df0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:33.981860 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8aa64f6a-d532-4bce-8193-6a04c6c50df0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:34.129169 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8aa64f6a-d532-4bce-8193-6a04c6c50df0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:34.137453 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-8aa64f6a-d532-4bce-8193-6a04c6c50df0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe" status: 200 len: 1681 microversion: 2.1 time: 0.170408 Aug 31 12:37:34.138039 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 371/735] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:33 2022] GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:35.167182 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-6f525ed9-fd31-465a-a1b2-d0137773f224 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:35.168060 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-6f525ed9-fd31-465a-a1b2-d0137773f224 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d921f6f0-2017-4941-8d52-1abe875c6ebe] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:35.175290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6f525ed9-fd31-465a-a1b2-d0137773f224 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:35.175776 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6f525ed9-fd31-465a-a1b2-d0137773f224 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:35.176205 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6f525ed9-fd31-465a-a1b2-d0137773f224 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:35.176908 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6f525ed9-fd31-465a-a1b2-d0137773f224 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:35.177357 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6f525ed9-fd31-465a-a1b2-d0137773f224 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:35.177775 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6f525ed9-fd31-465a-a1b2-d0137773f224 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:35.403116 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-6f525ed9-fd31-465a-a1b2-d0137773f224 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:35.411836 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-6f525ed9-fd31-465a-a1b2-d0137773f224 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe" status: 200 len: 1681 microversion: 2.1 time: 0.252873 Aug 31 12:37:35.412507 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 365/736] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:35 2022] GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe => generated 1681 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:35.942931 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-7f2549ab-4ad0-4425-93ca-a924431a5402 req-1fe00fff-6323-4867-9862-4ea95e90da48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d921f6f0-2017-4941-8d52-1abe875c6ebe", "name": "network-vif-deleted", "tag": "5e09f684-a590-4082-ad90-cdda42260677"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:37:35.964319 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-7f2549ab-4ad0-4425-93ca-a924431a5402 req-1fe00fff-6323-4867-9862-4ea95e90da48 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:35.965651 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-7f2549ab-4ad0-4425-93ca-a924431a5402 req-1fe00fff-6323-4867-9862-4ea95e90da48 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:35.966376 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-7f2549ab-4ad0-4425-93ca-a924431a5402 req-1fe00fff-6323-4867-9862-4ea95e90da48 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:35.986159 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-7f2549ab-4ad0-4425-93ca-a924431a5402 req-1fe00fff-6323-4867-9862-4ea95e90da48 service nova] Creating event network-vif-deleted:5e09f684-a590-4082-ad90-cdda42260677 for instance d921f6f0-2017-4941-8d52-1abe875c6ebe on hv-cinder-85528 Aug 31 12:37:35.993534 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-7f2549ab-4ad0-4425-93ca-a924431a5402 req-1fe00fff-6323-4867-9862-4ea95e90da48 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064662 Aug 31 12:37:35.998150 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 372/737] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:37:36.449242 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-4fdfa061-2c1a-4314-94a9-911703977229 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:36.452458 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-4fdfa061-2c1a-4314-94a9-911703977229 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d921f6f0-2017-4941-8d52-1abe875c6ebe] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:36.466030 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4fdfa061-2c1a-4314-94a9-911703977229 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:36.466030 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4fdfa061-2c1a-4314-94a9-911703977229 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:36.466030 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4fdfa061-2c1a-4314-94a9-911703977229 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:36.466919 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4fdfa061-2c1a-4314-94a9-911703977229 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:36.467212 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4fdfa061-2c1a-4314-94a9-911703977229 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:36.467842 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4fdfa061-2c1a-4314-94a9-911703977229 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:36.512533 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4fdfa061-2c1a-4314-94a9-911703977229 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:36.513354 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4fdfa061-2c1a-4314-94a9-911703977229 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:36.513893 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4fdfa061-2c1a-4314-94a9-911703977229 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:36.514459 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.objects.instance [None req-4fdfa061-2c1a-4314-94a9-911703977229 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lazy-loading 'fault' on Instance uuid d921f6f0-2017-4941-8d52-1abe875c6ebe {{(pid=120750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:37:36.594157 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-4fdfa061-2c1a-4314-94a9-911703977229 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:36.600103 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:36.617286 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-4fdfa061-2c1a-4314-94a9-911703977229 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe" status: 200 len: 1331 microversion: 2.1 time: 0.176442 Aug 31 12:37:36.620588 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 366/738] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:36 2022] GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe => generated 1331 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:36.689245 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-e6fe8eb9-7f9e-465a-843a-28b5cc1a04ef tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96bcf83f-4e9e-4b8d-84ee-69e65341400f", "device": "/dev/sdb"}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:37:36.695304 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-e6fe8eb9-7f9e-465a-843a-28b5cc1a04ef tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: 87f1b460-e745-4493-b38a-8a6ae3780e72] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:36.707071 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e6fe8eb9-7f9e-465a-843a-28b5cc1a04ef tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:36.708241 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e6fe8eb9-7f9e-465a-843a-28b5cc1a04ef tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:36.709475 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e6fe8eb9-7f9e-465a-843a-28b5cc1a04ef tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:36.710995 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e6fe8eb9-7f9e-465a-843a-28b5cc1a04ef tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:36.712084 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e6fe8eb9-7f9e-465a-843a-28b5cc1a04ef tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:36.713648 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e6fe8eb9-7f9e-465a-843a-28b5cc1a04ef tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:37.162797 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:37.182728 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-e6fe8eb9-7f9e-465a-843a-28b5cc1a04ef tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "POST /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.500493 Aug 31 12:37:37.183861 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 373/739] 10.222.0.79 () {60 vars in 1323 bytes} [Wed Aug 31 12:37:36 2022] POST /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72/os-volume_attachments => generated 194 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:37:37.644383 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-e7f58579-174f-4a83-b426-833c57b6bb59 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:37.645228 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-e7f58579-174f-4a83-b426-833c57b6bb59 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d921f6f0-2017-4941-8d52-1abe875c6ebe] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:37.648227 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:37.659550 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e7f58579-174f-4a83-b426-833c57b6bb59 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:37.660321 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e7f58579-174f-4a83-b426-833c57b6bb59 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:37.661057 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e7f58579-174f-4a83-b426-833c57b6bb59 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:37.663603 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e7f58579-174f-4a83-b426-833c57b6bb59 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:37.664705 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e7f58579-174f-4a83-b426-833c57b6bb59 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:37.665813 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e7f58579-174f-4a83-b426-833c57b6bb59 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:37.688858 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-e7f58579-174f-4a83-b426-833c57b6bb59 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] HTTP exception thrown: Instance d921f6f0-2017-4941-8d52-1abe875c6ebe could not be found. Aug 31 12:37:37.692144 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-e7f58579-174f-4a83-b426-833c57b6bb59 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Request method failure captured: Aug 31 12:37:37.692144 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe HTTP/1.1 Aug 31 12:37:37.692144 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:37:37.692144 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:37:37.692144 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:37:37.692144 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 0 Aug 31 12:37:37.692144 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:37:37.692144 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:37:37.692144 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:37:37.692144 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:37:37.692144 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1WA4hDI1B8mwzFgw9UjF0bHYxh-W0PYTg_8OeWEX87GiaZzZhuOr6eQtJ_dbJdWxGbnvcJjpQHDWtPVijl1hs_KhQSiluyTrf3Gs1WSceTlpv-MeDVwBqGReHlFVzM62nzVejCXNhnFRVyOFKPna_2ISD5If38YADpegsr8a3mNzBI Aug 31 12:37:37.692144 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:37:37.692144 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:37:37.692144 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:37:37.692144 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:37:37.692144 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:37:37.692144 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:37:37.692144 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: 8f6da846ab4f45a6ac4b2e34bf52abfc Aug 31 12:37:37.692144 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:37:37.692144 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:37:37.692144 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:37:37.695064 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8f6da846ab4f45a6ac4b2e34bf52abfc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:37:37.695064 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:37:37.695064 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: 8f6da846ab4f45a6ac4b2e34bf52abfc Aug 31 12:37:37.695064 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:37:37.695064 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-AttachVolumeNegativeTest-2001270308-project Aug 31 12:37:37.695064 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:37:37.695064 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:37:37.695064 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: d277532df42244c693b5e51e9fd0c459 Aug 31 12:37:37.695064 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-AttachVolumeNegativeTest-2001270308-project Aug 31 12:37:37.695064 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:37:37.695064 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Instance d921f6f0-2017-4941-8d52-1abe875c6ebe could not be found. Aug 31 12:37:37.695064 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'id': 'd921f6f0-2017-4941-8d52-1abe875c6ebe'} Aug 31 12:37:37.696694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:37:37.696694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:37:37.696694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:37:37.696694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:37:37.696694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:37:37.696694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:37:37.696694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:37:37.696694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:37:37.696694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:37:37.696694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:37:37.696694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d921f6f0-2017-4941-8d52-1abe875c6ebe could not be found. Aug 31 12:37:37.696694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:37:37.696694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:37:37.696694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:37:37.696694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:37:37.696694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:37:37.696694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:37:37.696694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:37:37.696694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:37:37.696694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:37:37.699710 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:37:37.699710 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:37:37.699710 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:37:37.699710 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:37:37.699710 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:37:37.699710 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:37:37.699710 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:37:37.699710 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d921f6f0-2017-4941-8d52-1abe875c6ebe could not be found. Aug 31 12:37:37.699710 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:37:37.699710 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:37:37.699710 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:37:37.699710 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:37:37.699710 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:37:37.699710 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:37:37.699710 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:37:37.699710 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:37:37.699710 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d921f6f0-2017-4941-8d52-1abe875c6ebe could not be found. Aug 31 12:37:37.699710 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:37:37.703602 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-e7f58579-174f-4a83-b426-833c57b6bb59 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Returning 404 to user: Instance d921f6f0-2017-4941-8d52-1abe875c6ebe could not be found. {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:37:37.704648 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-e7f58579-174f-4a83-b426-833c57b6bb59 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe" status: 404 len: 111 microversion: 2.1 time: 0.065777 Aug 31 12:37:37.705614 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 367/740] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:37 2022] GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 12:37:37.718895 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-049aca92-31cc-4201-8ae9-54dd354724ea tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '.version_select at 0x7f8d16fcdf70>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:37.750875 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-049aca92-31cc-4201-8ae9-54dd354724ea tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-670290293" status: 202 len: 0 microversion: 2.1 time: 0.038111 Aug 31 12:37:37.752067 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 374/741] 10.222.0.79 () {58 vars in 1218 bytes} [Wed Aug 31 12:37:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-670290293 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:37:38.676172 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-dec0879f-4a05-4915-95fb-5dbc75509d4a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Action: 'create', calling method: .version_select at 0x7f8d170baca0>, body: {"keypair": {"name": "tempest-keypair-86898781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHO64BvfLux4LwdfxzyREGIBYnqMdfb4AHyWA1LpHJXI4D/xRI0uU8SoZsaIyH/9dBiLL0VKmdIE7DhkLeJEAI6iWYBMSx9ArMVgfL4eE6R60gw43/3o8CyQ+UsxuIF1Bg=="}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:37:38.700992 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-dec0879f-4a05-4915-95fb-5dbc75509d4a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Getting quotas for project 8f6da846ab4f45a6ac4b2e34bf52abfc. Resources: {'key_pairs'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:37:38.708296 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-dec0879f-4a05-4915-95fb-5dbc75509d4a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Getting quotas for user d277532df42244c693b5e51e9fd0c459 and project 8f6da846ab4f45a6ac4b2e34bf52abfc. Resources: {'key_pairs'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:37:38.743060 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-dec0879f-4a05-4915-95fb-5dbc75509d4a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.070721 Aug 31 12:37:38.743677 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 368/742] 10.222.0.79 () {60 vars in 1159 bytes} [Wed Aug 31 12:37:38 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:37:41.147011 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-1feef2fc-fa19-4b69-b214-2990a7adc60a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-638652544", "imageRef": "2aaf4ebd-395b-468e-bb6b-c663d01edea0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ccc93a47-ca46-4185-ba4c-b528eb9d4e58"}], "security_groups": [{"name": "tempest-securitygroup--494181780"}], "key_name": "tempest-keypair-86898781", "user_data": "}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:37:41.165453 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:41.310530 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.network.neutron [None req-1feef2fc-fa19-4b69-b214-2990a7adc60a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] validate_networks() for [('ccc93a47-ca46-4185-ba4c-b528eb9d4e58', None, None, None, None, None)] {{(pid=120749) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:37:41.842799 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-1feef2fc-fa19-4b69-b214-2990a7adc60a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Flavor limits 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:37:41.844279 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-1feef2fc-fa19-4b69-b214-2990a7adc60a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Image limits 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:37:41.845420 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-1feef2fc-fa19-4b69-b214-2990a7adc60a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Flavor pref 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:37:41.846777 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-1feef2fc-fa19-4b69-b214-2990a7adc60a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Image pref 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:37:41.847901 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-1feef2fc-fa19-4b69-b214-2990a7adc60a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:37:41.868530 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1feef2fc-fa19-4b69-b214-2990a7adc60a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:41.869899 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1feef2fc-fa19-4b69-b214-2990a7adc60a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:41.870600 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1feef2fc-fa19-4b69-b214-2990a7adc60a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:41.872040 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1feef2fc-fa19-4b69-b214-2990a7adc60a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:41.872957 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1feef2fc-fa19-4b69-b214-2990a7adc60a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:41.873625 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1feef2fc-fa19-4b69-b214-2990a7adc60a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:41.902714 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-1feef2fc-fa19-4b69-b214-2990a7adc60a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Getting quotas for project 8f6da846ab4f45a6ac4b2e34bf52abfc. Resources: {'cores', 'ram', 'instances'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:37:41.908370 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-1feef2fc-fa19-4b69-b214-2990a7adc60a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Getting quotas for user d277532df42244c693b5e51e9fd0c459 and project 8f6da846ab4f45a6ac4b2e34bf52abfc. Resources: {'cores', 'ram', 'instances'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:37:41.926018 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-1feef2fc-fa19-4b69-b214-2990a7adc60a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Going to run 1 instances... {{(pid=120749) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:37:41.929399 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-1feef2fc-fa19-4b69-b214-2990a7adc60a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aaf4ebd-395b-468e-bb6b-c663d01edea0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:37:41.990977 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-1feef2fc-fa19-4b69-b214-2990a7adc60a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.852232 Aug 31 12:37:41.992936 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 375/743] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 31 12:37:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:37:42.011103 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-e4648282-1612-4095-9114-e0f7ae50fd90 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:42.012381 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-e4648282-1612-4095-9114-e0f7ae50fd90 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:42.120200 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-e4648282-1612-4095-9114-e0f7ae50fd90 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:42.128411 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-e4648282-1612-4095-9114-e0f7ae50fd90 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1239 microversion: 2.1 time: 0.126115 Aug 31 12:37:42.129931 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 369/744] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:42 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1239 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:43.159624 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-0f49a557-6d5d-4656-ad46-d85dc84a3017 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:43.161208 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-0f49a557-6d5d-4656-ad46-d85dc84a3017 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:43.173750 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0f49a557-6d5d-4656-ad46-d85dc84a3017 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:43.174489 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0f49a557-6d5d-4656-ad46-d85dc84a3017 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:43.175134 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0f49a557-6d5d-4656-ad46-d85dc84a3017 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:43.176119 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0f49a557-6d5d-4656-ad46-d85dc84a3017 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:43.177084 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0f49a557-6d5d-4656-ad46-d85dc84a3017 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:43.178057 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0f49a557-6d5d-4656-ad46-d85dc84a3017 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:43.340426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-0f49a557-6d5d-4656-ad46-d85dc84a3017 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:43.358348 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-0f49a557-6d5d-4656-ad46-d85dc84a3017 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1235 microversion: 2.1 time: 0.204353 Aug 31 12:37:43.360047 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 376/745] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:43 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1235 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:44.406170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-2f3be2ce-e630-412e-835e-a22bd02ccef1 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:44.407419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-2f3be2ce-e630-412e-835e-a22bd02ccef1 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:44.424247 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2f3be2ce-e630-412e-835e-a22bd02ccef1 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:44.425404 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2f3be2ce-e630-412e-835e-a22bd02ccef1 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:44.426335 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2f3be2ce-e630-412e-835e-a22bd02ccef1 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:44.427840 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2f3be2ce-e630-412e-835e-a22bd02ccef1 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:44.429026 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2f3be2ce-e630-412e-835e-a22bd02ccef1 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:44.435482 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2f3be2ce-e630-412e-835e-a22bd02ccef1 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:44.546338 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-2f3be2ce-e630-412e-835e-a22bd02ccef1 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:44.555268 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-2f3be2ce-e630-412e-835e-a22bd02ccef1 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1291 microversion: 2.1 time: 0.158663 Aug 31 12:37:44.555891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 370/746] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:44 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1291 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:45.578050 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-d3b33f5c-7a5f-4e9f-affa-1ecd76abe2ad tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:45.578816 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-d3b33f5c-7a5f-4e9f-affa-1ecd76abe2ad tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:45.585787 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d3b33f5c-7a5f-4e9f-affa-1ecd76abe2ad tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:45.586277 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d3b33f5c-7a5f-4e9f-affa-1ecd76abe2ad tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:45.586712 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d3b33f5c-7a5f-4e9f-affa-1ecd76abe2ad tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:45.587460 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d3b33f5c-7a5f-4e9f-affa-1ecd76abe2ad tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:45.588491 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d3b33f5c-7a5f-4e9f-affa-1ecd76abe2ad tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:45.588916 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d3b33f5c-7a5f-4e9f-affa-1ecd76abe2ad tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:45.662091 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-d3b33f5c-7a5f-4e9f-affa-1ecd76abe2ad tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:45.671556 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-d3b33f5c-7a5f-4e9f-affa-1ecd76abe2ad tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1299 microversion: 2.1 time: 0.097624 Aug 31 12:37:45.672150 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 377/747] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:45 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1299 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:46.694430 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-c485b25d-b0bf-422e-935e-c2d0cf41bf52 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:46.695086 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-c485b25d-b0bf-422e-935e-c2d0cf41bf52 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:46.702420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c485b25d-b0bf-422e-935e-c2d0cf41bf52 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:46.702950 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c485b25d-b0bf-422e-935e-c2d0cf41bf52 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:46.703401 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c485b25d-b0bf-422e-935e-c2d0cf41bf52 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:46.704130 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c485b25d-b0bf-422e-935e-c2d0cf41bf52 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:46.704591 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c485b25d-b0bf-422e-935e-c2d0cf41bf52 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:46.705016 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c485b25d-b0bf-422e-935e-c2d0cf41bf52 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:46.797816 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-c485b25d-b0bf-422e-935e-c2d0cf41bf52 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:46.806570 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-c485b25d-b0bf-422e-935e-c2d0cf41bf52 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1299 microversion: 2.1 time: 0.116109 Aug 31 12:37:46.807199 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 371/748] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:46 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1299 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:47.831519 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-ce530ccc-2fba-43e9-81f3-fd908d339111 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:47.832127 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-ce530ccc-2fba-43e9-81f3-fd908d339111 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:47.840253 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ce530ccc-2fba-43e9-81f3-fd908d339111 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:47.840858 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ce530ccc-2fba-43e9-81f3-fd908d339111 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:47.841211 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ce530ccc-2fba-43e9-81f3-fd908d339111 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:47.841944 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ce530ccc-2fba-43e9-81f3-fd908d339111 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:47.842455 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ce530ccc-2fba-43e9-81f3-fd908d339111 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:47.842896 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ce530ccc-2fba-43e9-81f3-fd908d339111 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:47.923216 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-ce530ccc-2fba-43e9-81f3-fd908d339111 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:47.937234 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-ce530ccc-2fba-43e9-81f3-fd908d339111 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1297 microversion: 2.1 time: 0.111330 Aug 31 12:37:47.938576 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 378/749] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:47 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1297 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:48.829754 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-068be2c9-1c63-4103-ac1c-931b25e5a438 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1011150608", "imageRef": "2aaf4ebd-395b-468e-bb6b-c663d01edea0", "flavorRef": "452", "networks": [{"uuid": "11e9fd5d-01c8-4616-bf01-2803d4e9694e"}]}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:37:48.906375 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.network.neutron [None req-068be2c9-1c63-4103-ac1c-931b25e5a438 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] validate_networks() for [('11e9fd5d-01c8-4616-bf01-2803d4e9694e', None, None, None, None, None)] {{(pid=120750) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:37:48.973046 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-0230d9cb-af46-418c-9574-c438fff1d415 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:48.973747 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-0230d9cb-af46-418c-9574-c438fff1d415 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:48.982510 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0230d9cb-af46-418c-9574-c438fff1d415 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:48.983145 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0230d9cb-af46-418c-9574-c438fff1d415 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:48.985688 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0230d9cb-af46-418c-9574-c438fff1d415 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:48.985688 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0230d9cb-af46-418c-9574-c438fff1d415 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:48.985688 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0230d9cb-af46-418c-9574-c438fff1d415 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:48.985688 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0230d9cb-af46-418c-9574-c438fff1d415 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:49.146783 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-0230d9cb-af46-418c-9574-c438fff1d415 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:49.156376 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-0230d9cb-af46-418c-9574-c438fff1d415 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1364 microversion: 2.1 time: 0.189062 Aug 31 12:37:49.156967 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 379/750] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:48 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:49.546081 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-7eb2998a-1451-4f89-a041-75856c6d9274 req-76930c99-69b3-492b-8ad3-3fa99ff8f2d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0be9b94a-a5f6-4443-862e-e33f7a794c98", "tag": "18d85183-cc62-46fa-94cd-7d3b37300e7d"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:37:49.561394 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-7eb2998a-1451-4f89-a041-75856c6d9274 req-76930c99-69b3-492b-8ad3-3fa99ff8f2d1 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:49.562219 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-7eb2998a-1451-4f89-a041-75856c6d9274 req-76930c99-69b3-492b-8ad3-3fa99ff8f2d1 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:49.562806 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-7eb2998a-1451-4f89-a041-75856c6d9274 req-76930c99-69b3-492b-8ad3-3fa99ff8f2d1 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:49.577562 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-7eb2998a-1451-4f89-a041-75856c6d9274 req-76930c99-69b3-492b-8ad3-3fa99ff8f2d1 service nova] Creating event network-changed:18d85183-cc62-46fa-94cd-7d3b37300e7d for instance 0be9b94a-a5f6-4443-862e-e33f7a794c98 on hv-cinder-85528 Aug 31 12:37:49.583623 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-7eb2998a-1451-4f89-a041-75856c6d9274 req-76930c99-69b3-492b-8ad3-3fa99ff8f2d1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047167 Aug 31 12:37:49.585012 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 380/751] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:37:49.614270 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-068be2c9-1c63-4103-ac1c-931b25e5a438 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Flavor limits 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:37:49.614816 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-068be2c9-1c63-4103-ac1c-931b25e5a438 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Image limits 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:37:49.615809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-068be2c9-1c63-4103-ac1c-931b25e5a438 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Flavor pref 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:37:49.616250 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-068be2c9-1c63-4103-ac1c-931b25e5a438 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Image pref 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:37:49.616738 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-068be2c9-1c63-4103-ac1c-931b25e5a438 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:37:49.628499 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-068be2c9-1c63-4103-ac1c-931b25e5a438 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:49.629005 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-068be2c9-1c63-4103-ac1c-931b25e5a438 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:49.629432 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-068be2c9-1c63-4103-ac1c-931b25e5a438 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:49.630149 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-068be2c9-1c63-4103-ac1c-931b25e5a438 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:49.630596 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-068be2c9-1c63-4103-ac1c-931b25e5a438 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:49.631044 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-068be2c9-1c63-4103-ac1c-931b25e5a438 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:49.651871 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-068be2c9-1c63-4103-ac1c-931b25e5a438 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Getting quotas for project c5c8e3638b084b768d8ba4b0202af99d. Resources: {'cores', 'ram', 'instances'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:37:49.657526 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-068be2c9-1c63-4103-ac1c-931b25e5a438 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Getting quotas for user b4ca778b2f2f45c29cc99cbbe190d76a and project c5c8e3638b084b768d8ba4b0202af99d. Resources: {'cores', 'ram', 'instances'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:37:49.672181 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-068be2c9-1c63-4103-ac1c-931b25e5a438 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Going to run 1 instances... {{(pid=120750) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:37:49.674971 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-068be2c9-1c63-4103-ac1c-931b25e5a438 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 2256ff6f-c9cf-4d88-9453-6086f51f68dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aaf4ebd-395b-468e-bb6b-c663d01edea0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120750) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:37:49.733418 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-068be2c9-1c63-4103-ac1c-931b25e5a438 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.907595 Aug 31 12:37:49.734084 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 372/752] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 31 12:37:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:37:49.748406 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-8bf4ba30-b512-4b68-8c27-ee33fcf9e50a tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:49.749261 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-8bf4ba30-b512-4b68-8c27-ee33fcf9e50a tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 2256ff6f-c9cf-4d88-9453-6086f51f68dd] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:49.814937 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8bf4ba30-b512-4b68-8c27-ee33fcf9e50a tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:49.827691 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-8bf4ba30-b512-4b68-8c27-ee33fcf9e50a tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd" status: 200 len: 1214 microversion: 2.1 time: 0.085206 Aug 31 12:37:49.828269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 381/753] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:49 2022] GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:50.178361 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-daaeb02b-7b57-4a69-acbd-ca5666078d9d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:50.179222 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-daaeb02b-7b57-4a69-acbd-ca5666078d9d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:50.185819 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-daaeb02b-7b57-4a69-acbd-ca5666078d9d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:50.186340 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-daaeb02b-7b57-4a69-acbd-ca5666078d9d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:50.186764 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-daaeb02b-7b57-4a69-acbd-ca5666078d9d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:50.187501 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-daaeb02b-7b57-4a69-acbd-ca5666078d9d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:50.187952 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-daaeb02b-7b57-4a69-acbd-ca5666078d9d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:50.188371 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-daaeb02b-7b57-4a69-acbd-ca5666078d9d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:50.365642 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-daaeb02b-7b57-4a69-acbd-ca5666078d9d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:50.374317 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-daaeb02b-7b57-4a69-acbd-ca5666078d9d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1364 microversion: 2.1 time: 0.200497 Aug 31 12:37:50.374939 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 373/754] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:50 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1364 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:50.851053 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-a8c02982-9ad8-4210-bfa1-298ccc4df037 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:50.852268 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-a8c02982-9ad8-4210-bfa1-298ccc4df037 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 2256ff6f-c9cf-4d88-9453-6086f51f68dd] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:50.861578 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a8c02982-9ad8-4210-bfa1-298ccc4df037 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:50.862221 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a8c02982-9ad8-4210-bfa1-298ccc4df037 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:50.862777 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a8c02982-9ad8-4210-bfa1-298ccc4df037 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:50.863745 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a8c02982-9ad8-4210-bfa1-298ccc4df037 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:50.864499 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a8c02982-9ad8-4210-bfa1-298ccc4df037 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:50.865639 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a8c02982-9ad8-4210-bfa1-298ccc4df037 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:50.955682 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-a8c02982-9ad8-4210-bfa1-298ccc4df037 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:50.964467 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-a8c02982-9ad8-4210-bfa1-298ccc4df037 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd" status: 200 len: 1218 microversion: 2.1 time: 0.118639 Aug 31 12:37:50.965050 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 382/755] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:50 2022] GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:51.396483 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-ec48b448-81f2-4080-a849-ed1579162129 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:51.397363 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-ec48b448-81f2-4080-a849-ed1579162129 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:51.407065 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ec48b448-81f2-4080-a849-ed1579162129 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:51.407836 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ec48b448-81f2-4080-a849-ed1579162129 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:51.408390 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ec48b448-81f2-4080-a849-ed1579162129 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:51.409237 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ec48b448-81f2-4080-a849-ed1579162129 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:51.409792 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ec48b448-81f2-4080-a849-ed1579162129 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:51.410590 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ec48b448-81f2-4080-a849-ed1579162129 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:51.573552 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-ec48b448-81f2-4080-a849-ed1579162129 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:51.593357 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-ec48b448-81f2-4080-a849-ed1579162129 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1364 microversion: 2.1 time: 0.201011 Aug 31 12:37:51.594048 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 374/756] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:51 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1364 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:51.991993 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-bc3e70e0-3ff3-42c7-8cc5-6bb7a41fd3e3 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:51.992611 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-bc3e70e0-3ff3-42c7-8cc5-6bb7a41fd3e3 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 2256ff6f-c9cf-4d88-9453-6086f51f68dd] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:51.996119 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=2 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:52.001963 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bc3e70e0-3ff3-42c7-8cc5-6bb7a41fd3e3 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:52.002454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bc3e70e0-3ff3-42c7-8cc5-6bb7a41fd3e3 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:52.002939 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bc3e70e0-3ff3-42c7-8cc5-6bb7a41fd3e3 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:52.003972 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bc3e70e0-3ff3-42c7-8cc5-6bb7a41fd3e3 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:52.004858 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bc3e70e0-3ff3-42c7-8cc5-6bb7a41fd3e3 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:52.004858 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bc3e70e0-3ff3-42c7-8cc5-6bb7a41fd3e3 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:52.104365 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-bc3e70e0-3ff3-42c7-8cc5-6bb7a41fd3e3 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:52.117724 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-bc3e70e0-3ff3-42c7-8cc5-6bb7a41fd3e3 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd" status: 200 len: 1210 microversion: 2.1 time: 0.129325 Aug 31 12:37:52.119194 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 383/757] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:51 2022] GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd => generated 1210 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:52.618027 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-66a873a9-4049-4fc1-85ac-95aa0c28e8e2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:52.619265 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-66a873a9-4049-4fc1-85ac-95aa0c28e8e2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:52.626837 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-66a873a9-4049-4fc1-85ac-95aa0c28e8e2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:52.627354 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-66a873a9-4049-4fc1-85ac-95aa0c28e8e2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:52.628042 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-66a873a9-4049-4fc1-85ac-95aa0c28e8e2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:52.629099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-66a873a9-4049-4fc1-85ac-95aa0c28e8e2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:52.629808 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-66a873a9-4049-4fc1-85ac-95aa0c28e8e2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:52.630243 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-66a873a9-4049-4fc1-85ac-95aa0c28e8e2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:52.916561 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-66a873a9-4049-4fc1-85ac-95aa0c28e8e2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:52.928991 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-66a873a9-4049-4fc1-85ac-95aa0c28e8e2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1364 microversion: 2.1 time: 0.315776 Aug 31 12:37:52.929916 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 375/758] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:52 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1364 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:53.160474 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-1303d8cf-ce11-4e34-bcb5-c437d85d9718 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:53.162987 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-1303d8cf-ce11-4e34-bcb5-c437d85d9718 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 2256ff6f-c9cf-4d88-9453-6086f51f68dd] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:53.178752 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1303d8cf-ce11-4e34-bcb5-c437d85d9718 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:53.180772 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1303d8cf-ce11-4e34-bcb5-c437d85d9718 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:53.182280 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1303d8cf-ce11-4e34-bcb5-c437d85d9718 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:53.184300 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1303d8cf-ce11-4e34-bcb5-c437d85d9718 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:53.185276 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1303d8cf-ce11-4e34-bcb5-c437d85d9718 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:53.186345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1303d8cf-ce11-4e34-bcb5-c437d85d9718 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:53.293250 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-1303d8cf-ce11-4e34-bcb5-c437d85d9718 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:53.303900 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-1303d8cf-ce11-4e34-bcb5-c437d85d9718 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd" status: 200 len: 1272 microversion: 2.1 time: 0.154960 Aug 31 12:37:53.305213 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 384/759] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:53 2022] GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:53.965187 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-af3bbea1-1c2d-4a11-a54f-cf733d0512aa tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:53.965755 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-af3bbea1-1c2d-4a11-a54f-cf733d0512aa tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:53.972444 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-af3bbea1-1c2d-4a11-a54f-cf733d0512aa tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:53.972929 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-af3bbea1-1c2d-4a11-a54f-cf733d0512aa tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:53.973366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-af3bbea1-1c2d-4a11-a54f-cf733d0512aa tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:53.974072 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-af3bbea1-1c2d-4a11-a54f-cf733d0512aa tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:53.974524 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-af3bbea1-1c2d-4a11-a54f-cf733d0512aa tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:53.974979 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-af3bbea1-1c2d-4a11-a54f-cf733d0512aa tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:54.128622 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-af3bbea1-1c2d-4a11-a54f-cf733d0512aa tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:54.138036 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-af3bbea1-1c2d-4a11-a54f-cf733d0512aa tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1364 microversion: 2.1 time: 0.176910 Aug 31 12:37:54.138631 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 376/760] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:53 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:54.332124 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-7bb88667-a952-4715-ac5e-991c780fa977 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:54.332900 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-7bb88667-a952-4715-ac5e-991c780fa977 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 2256ff6f-c9cf-4d88-9453-6086f51f68dd] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:54.343564 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7bb88667-a952-4715-ac5e-991c780fa977 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:54.344075 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7bb88667-a952-4715-ac5e-991c780fa977 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:54.344483 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7bb88667-a952-4715-ac5e-991c780fa977 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:54.345208 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7bb88667-a952-4715-ac5e-991c780fa977 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:54.345667 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7bb88667-a952-4715-ac5e-991c780fa977 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:54.346096 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7bb88667-a952-4715-ac5e-991c780fa977 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:54.505637 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-7bb88667-a952-4715-ac5e-991c780fa977 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:54.521222 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-7bb88667-a952-4715-ac5e-991c780fa977 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd" status: 200 len: 1314 microversion: 2.1 time: 0.192917 Aug 31 12:37:54.521819 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 385/761] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:54 2022] GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:55.162656 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-817f45b7-9fdf-4815-9c47-967910ec267a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:55.163734 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-817f45b7-9fdf-4815-9c47-967910ec267a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:55.175315 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-817f45b7-9fdf-4815-9c47-967910ec267a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:55.175983 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-817f45b7-9fdf-4815-9c47-967910ec267a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:55.176710 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-817f45b7-9fdf-4815-9c47-967910ec267a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:55.177894 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-817f45b7-9fdf-4815-9c47-967910ec267a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:55.178664 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-817f45b7-9fdf-4815-9c47-967910ec267a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:55.179421 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-817f45b7-9fdf-4815-9c47-967910ec267a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:55.336494 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-817f45b7-9fdf-4815-9c47-967910ec267a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:55.346974 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-817f45b7-9fdf-4815-9c47-967910ec267a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1364 microversion: 2.1 time: 0.190727 Aug 31 12:37:55.347474 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 377/762] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:55 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1364 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:55.543424 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-d5478d50-216a-430f-803b-8686c8217aeb tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:55.544025 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-d5478d50-216a-430f-803b-8686c8217aeb tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 2256ff6f-c9cf-4d88-9453-6086f51f68dd] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:55.550766 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d5478d50-216a-430f-803b-8686c8217aeb tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:55.551291 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d5478d50-216a-430f-803b-8686c8217aeb tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:55.551722 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d5478d50-216a-430f-803b-8686c8217aeb tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:55.552518 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d5478d50-216a-430f-803b-8686c8217aeb tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:55.552976 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d5478d50-216a-430f-803b-8686c8217aeb tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:55.553411 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d5478d50-216a-430f-803b-8686c8217aeb tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:55.703523 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-d5478d50-216a-430f-803b-8686c8217aeb tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:55.711582 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-d5478d50-216a-430f-803b-8686c8217aeb tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd" status: 200 len: 1314 microversion: 2.1 time: 0.172190 Aug 31 12:37:55.712187 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 386/763] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:55 2022] GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:56.373294 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-666df749-a66a-44f5-895e-5a2fb33ba716 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:56.373929 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-666df749-a66a-44f5-895e-5a2fb33ba716 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:56.380620 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-666df749-a66a-44f5-895e-5a2fb33ba716 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:56.381101 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-666df749-a66a-44f5-895e-5a2fb33ba716 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:56.381530 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-666df749-a66a-44f5-895e-5a2fb33ba716 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:56.382501 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-666df749-a66a-44f5-895e-5a2fb33ba716 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:56.382647 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-666df749-a66a-44f5-895e-5a2fb33ba716 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:56.383159 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-666df749-a66a-44f5-895e-5a2fb33ba716 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:56.554651 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-666df749-a66a-44f5-895e-5a2fb33ba716 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:56.563244 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-666df749-a66a-44f5-895e-5a2fb33ba716 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1364 microversion: 2.1 time: 0.194454 Aug 31 12:37:56.563839 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 378/764] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:56 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:56.733101 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-957ead21-6fb3-402b-8bf1-43e7fce86211 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:56.733663 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-957ead21-6fb3-402b-8bf1-43e7fce86211 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 2256ff6f-c9cf-4d88-9453-6086f51f68dd] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:56.740741 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-957ead21-6fb3-402b-8bf1-43e7fce86211 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:56.741330 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-957ead21-6fb3-402b-8bf1-43e7fce86211 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:56.741772 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-957ead21-6fb3-402b-8bf1-43e7fce86211 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:56.742504 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-957ead21-6fb3-402b-8bf1-43e7fce86211 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:56.742990 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-957ead21-6fb3-402b-8bf1-43e7fce86211 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:56.743426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-957ead21-6fb3-402b-8bf1-43e7fce86211 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:57.006399 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-957ead21-6fb3-402b-8bf1-43e7fce86211 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:57.015585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-957ead21-6fb3-402b-8bf1-43e7fce86211 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd" status: 200 len: 1314 microversion: 2.1 time: 0.286522 Aug 31 12:37:57.016191 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 387/765] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:56 2022] GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:57.462069 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-13600e05-693c-44cd-aef9-2ac17dd30f5c req-424f4e6c-efc1-41e4-b344-950077f55bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2256ff6f-c9cf-4d88-9453-6086f51f68dd", "tag": "786dbde8-8b96-4aa1-939b-eb0e976c9e2f"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:37:57.484745 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-13600e05-693c-44cd-aef9-2ac17dd30f5c req-424f4e6c-efc1-41e4-b344-950077f55bc7 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:57.485346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-13600e05-693c-44cd-aef9-2ac17dd30f5c req-424f4e6c-efc1-41e4-b344-950077f55bc7 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:57.485857 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-13600e05-693c-44cd-aef9-2ac17dd30f5c req-424f4e6c-efc1-41e4-b344-950077f55bc7 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:57.504492 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-13600e05-693c-44cd-aef9-2ac17dd30f5c req-424f4e6c-efc1-41e4-b344-950077f55bc7 service nova] Creating event network-changed:786dbde8-8b96-4aa1-939b-eb0e976c9e2f for instance 2256ff6f-c9cf-4d88-9453-6086f51f68dd on hv-cinder-85528 Aug 31 12:37:57.513279 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-13600e05-693c-44cd-aef9-2ac17dd30f5c req-424f4e6c-efc1-41e4-b344-950077f55bc7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056051 Aug 31 12:37:57.514168 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 379/766] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:37:57.587502 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-953687f9-05b7-4bc1-9206-102094dfe63a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:57.588147 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-953687f9-05b7-4bc1-9206-102094dfe63a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:57.594739 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-953687f9-05b7-4bc1-9206-102094dfe63a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:57.595746 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-953687f9-05b7-4bc1-9206-102094dfe63a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:57.596180 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-953687f9-05b7-4bc1-9206-102094dfe63a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:57.596900 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-953687f9-05b7-4bc1-9206-102094dfe63a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:57.597356 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-953687f9-05b7-4bc1-9206-102094dfe63a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:57.597781 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-953687f9-05b7-4bc1-9206-102094dfe63a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:58.038976 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-98023f7d-75aa-4266-80a7-1500b397ce3e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:58.039730 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-98023f7d-75aa-4266-80a7-1500b397ce3e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 2256ff6f-c9cf-4d88-9453-6086f51f68dd] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:58.047438 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-98023f7d-75aa-4266-80a7-1500b397ce3e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:58.047934 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-98023f7d-75aa-4266-80a7-1500b397ce3e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:58.048370 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-98023f7d-75aa-4266-80a7-1500b397ce3e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:58.049103 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-98023f7d-75aa-4266-80a7-1500b397ce3e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:58.049566 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-98023f7d-75aa-4266-80a7-1500b397ce3e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:58.050000 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-98023f7d-75aa-4266-80a7-1500b397ce3e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:58.129721 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-953687f9-05b7-4bc1-9206-102094dfe63a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:58.138144 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-953687f9-05b7-4bc1-9206-102094dfe63a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1364 microversion: 2.1 time: 0.554630 Aug 31 12:37:58.143105 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 388/767] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:57 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1364 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:58.236369 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-98023f7d-75aa-4266-80a7-1500b397ce3e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:58.251650 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-98023f7d-75aa-4266-80a7-1500b397ce3e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd" status: 200 len: 1314 microversion: 2.1 time: 0.217419 Aug 31 12:37:58.252581 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 380/768] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:58 2022] GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:59.173885 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-f2597cc2-d8de-4bbf-8e51-88b6a8dcd669 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:59.175076 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-f2597cc2-d8de-4bbf-8e51-88b6a8dcd669 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:59.181960 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f2597cc2-d8de-4bbf-8e51-88b6a8dcd669 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:59.182571 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f2597cc2-d8de-4bbf-8e51-88b6a8dcd669 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:59.183062 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f2597cc2-d8de-4bbf-8e51-88b6a8dcd669 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:59.183783 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f2597cc2-d8de-4bbf-8e51-88b6a8dcd669 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:59.184245 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f2597cc2-d8de-4bbf-8e51-88b6a8dcd669 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:59.184671 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f2597cc2-d8de-4bbf-8e51-88b6a8dcd669 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:59.287720 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b3cafd44-3efe-4c2e-99cb-b6c58904859a tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:59.288630 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-b3cafd44-3efe-4c2e-99cb-b6c58904859a tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 2256ff6f-c9cf-4d88-9453-6086f51f68dd] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:59.296261 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b3cafd44-3efe-4c2e-99cb-b6c58904859a tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:59.296758 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b3cafd44-3efe-4c2e-99cb-b6c58904859a tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:59.297178 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b3cafd44-3efe-4c2e-99cb-b6c58904859a tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:59.297898 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b3cafd44-3efe-4c2e-99cb-b6c58904859a tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:59.298352 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b3cafd44-3efe-4c2e-99cb-b6c58904859a tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:59.298771 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b3cafd44-3efe-4c2e-99cb-b6c58904859a tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:59.342747 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-f2597cc2-d8de-4bbf-8e51-88b6a8dcd669 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:59.356422 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-f2597cc2-d8de-4bbf-8e51-88b6a8dcd669 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1364 microversion: 2.1 time: 0.186392 Aug 31 12:37:59.357358 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 389/769] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:59 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1364 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:59.459718 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b3cafd44-3efe-4c2e-99cb-b6c58904859a tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:59.468649 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b3cafd44-3efe-4c2e-99cb-b6c58904859a tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd" status: 200 len: 1314 microversion: 2.1 time: 0.184759 Aug 31 12:37:59.469213 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 381/770] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:59 2022] GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:00.377980 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-9be30ca3-31c1-43a9-8d56-f7d726d22e77 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:00.378589 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-9be30ca3-31c1-43a9-8d56-f7d726d22e77 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:00.380564 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=8 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:00.387164 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9be30ca3-31c1-43a9-8d56-f7d726d22e77 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:00.387663 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9be30ca3-31c1-43a9-8d56-f7d726d22e77 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:00.388100 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9be30ca3-31c1-43a9-8d56-f7d726d22e77 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:00.388805 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9be30ca3-31c1-43a9-8d56-f7d726d22e77 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:00.389265 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9be30ca3-31c1-43a9-8d56-f7d726d22e77 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:00.389688 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9be30ca3-31c1-43a9-8d56-f7d726d22e77 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:00.492293 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-2deb6d80-6949-4154-8673-07ddb80b66e4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:00.492974 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-2deb6d80-6949-4154-8673-07ddb80b66e4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 2256ff6f-c9cf-4d88-9453-6086f51f68dd] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:00.495664 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell0:SELECT=2 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:00.496927 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell0:SELECT=12 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:00.505920 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2deb6d80-6949-4154-8673-07ddb80b66e4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:00.506784 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2deb6d80-6949-4154-8673-07ddb80b66e4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:00.507504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2deb6d80-6949-4154-8673-07ddb80b66e4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:00.508280 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2deb6d80-6949-4154-8673-07ddb80b66e4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:00.509363 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2deb6d80-6949-4154-8673-07ddb80b66e4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:00.510135 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2deb6d80-6949-4154-8673-07ddb80b66e4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:00.535861 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-9be30ca3-31c1-43a9-8d56-f7d726d22e77 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:00.544479 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-9be30ca3-31c1-43a9-8d56-f7d726d22e77 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1364 microversion: 2.1 time: 0.170394 Aug 31 12:38:00.545061 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 390/771] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:00 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:00.657592 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-2deb6d80-6949-4154-8673-07ddb80b66e4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:00.666770 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-2deb6d80-6949-4154-8673-07ddb80b66e4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd" status: 200 len: 1314 microversion: 2.1 time: 0.177851 Aug 31 12:38:00.667421 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 382/772] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:00 2022] GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:01.565333 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-a96f9c17-29e6-4947-a0f1-850d8f0ab210 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:01.565933 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-a96f9c17-29e6-4947-a0f1-850d8f0ab210 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:01.572643 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a96f9c17-29e6-4947-a0f1-850d8f0ab210 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:01.573130 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a96f9c17-29e6-4947-a0f1-850d8f0ab210 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:01.573563 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a96f9c17-29e6-4947-a0f1-850d8f0ab210 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:01.574262 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a96f9c17-29e6-4947-a0f1-850d8f0ab210 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:01.574711 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a96f9c17-29e6-4947-a0f1-850d8f0ab210 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:01.575158 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a96f9c17-29e6-4947-a0f1-850d8f0ab210 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:01.688814 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-8c549c2f-4367-4d2f-b231-49fd32ab4102 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:01.690367 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-8c549c2f-4367-4d2f-b231-49fd32ab4102 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 2256ff6f-c9cf-4d88-9453-6086f51f68dd] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:01.700122 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8c549c2f-4367-4d2f-b231-49fd32ab4102 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:01.700703 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8c549c2f-4367-4d2f-b231-49fd32ab4102 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:01.701586 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8c549c2f-4367-4d2f-b231-49fd32ab4102 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:01.702653 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8c549c2f-4367-4d2f-b231-49fd32ab4102 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:01.703216 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8c549c2f-4367-4d2f-b231-49fd32ab4102 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:01.703647 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8c549c2f-4367-4d2f-b231-49fd32ab4102 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:01.717420 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-a96f9c17-29e6-4947-a0f1-850d8f0ab210 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:01.726275 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-a96f9c17-29e6-4947-a0f1-850d8f0ab210 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1364 microversion: 2.1 time: 0.164735 Aug 31 12:38:01.726906 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 391/773] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:01 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:01.847193 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-8c549c2f-4367-4d2f-b231-49fd32ab4102 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:01.861914 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-8c549c2f-4367-4d2f-b231-49fd32ab4102 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd" status: 200 len: 1314 microversion: 2.1 time: 0.176791 Aug 31 12:38:01.862862 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 383/774] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:01 2022] GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:02.749982 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-de8e41dd-0c88-46d0-bfc0-d6ce881db5c5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:02.750551 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-de8e41dd-0c88-46d0-bfc0-d6ce881db5c5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:02.757428 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-de8e41dd-0c88-46d0-bfc0-d6ce881db5c5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:02.757909 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-de8e41dd-0c88-46d0-bfc0-d6ce881db5c5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:02.758345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-de8e41dd-0c88-46d0-bfc0-d6ce881db5c5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:02.759062 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-de8e41dd-0c88-46d0-bfc0-d6ce881db5c5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:02.760063 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-de8e41dd-0c88-46d0-bfc0-d6ce881db5c5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:02.760490 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-de8e41dd-0c88-46d0-bfc0-d6ce881db5c5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:02.885032 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-57f256fe-eaa1-401b-83a1-3626ccd6d71e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:02.885958 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-57f256fe-eaa1-401b-83a1-3626ccd6d71e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 2256ff6f-c9cf-4d88-9453-6086f51f68dd] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:02.897057 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-57f256fe-eaa1-401b-83a1-3626ccd6d71e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:02.897558 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-57f256fe-eaa1-401b-83a1-3626ccd6d71e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:02.897998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-57f256fe-eaa1-401b-83a1-3626ccd6d71e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:02.898714 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-57f256fe-eaa1-401b-83a1-3626ccd6d71e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:02.899209 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-57f256fe-eaa1-401b-83a1-3626ccd6d71e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:02.900343 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-57f256fe-eaa1-401b-83a1-3626ccd6d71e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:02.912242 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-de8e41dd-0c88-46d0-bfc0-d6ce881db5c5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:02.921770 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-de8e41dd-0c88-46d0-bfc0-d6ce881db5c5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1364 microversion: 2.1 time: 0.176787 Aug 31 12:38:02.934878 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 392/775] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:02 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:02.990307 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-d66ad1c7-2b10-447b-b83e-ead0a8d597a6 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:02.991120 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-d66ad1c7-2b10-447b-b83e-ead0a8d597a6 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: 87f1b460-e745-4493-b38a-8a6ae3780e72] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:02.999919 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d66ad1c7-2b10-447b-b83e-ead0a8d597a6 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:03.000738 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d66ad1c7-2b10-447b-b83e-ead0a8d597a6 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:03.001170 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d66ad1c7-2b10-447b-b83e-ead0a8d597a6 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:03.002144 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d66ad1c7-2b10-447b-b83e-ead0a8d597a6 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:03.002502 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d66ad1c7-2b10-447b-b83e-ead0a8d597a6 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:03.003240 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d66ad1c7-2b10-447b-b83e-ead0a8d597a6 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:03.070130 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-57f256fe-eaa1-401b-83a1-3626ccd6d71e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:03.082032 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-57f256fe-eaa1-401b-83a1-3626ccd6d71e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd" status: 200 len: 1314 microversion: 2.1 time: 0.200574 Aug 31 12:38:03.083357 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 384/776] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:02 2022] GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:03.126922 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=100 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:03.131190 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.objects.instance [None req-d66ad1c7-2b10-447b-b83e-ead0a8d597a6 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lazy-loading 'services' on Instance uuid 87f1b460-e745-4493-b38a-8a6ae3780e72 {{(pid=120749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:38:03.242254 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-d66ad1c7-2b10-447b-b83e-ead0a8d597a6 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "DELETE /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72/os-volume_attachments/96bcf83f-4e9e-4b8d-84ee-69e65341400f" status: 202 len: 0 microversion: 2.1 time: 0.258844 Aug 31 12:38:03.244600 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 393/777] 10.222.0.79 () {58 vars in 1416 bytes} [Wed Aug 31 12:38:02 2022] DELETE /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72/os-volume_attachments/96bcf83f-4e9e-4b8d-84ee-69e65341400f => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:38:03.944645 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-2ec6ef3f-2c17-40f5-9c67-6067512a6653 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:03.945241 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-2ec6ef3f-2c17-40f5-9c67-6067512a6653 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:03.952537 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2ec6ef3f-2c17-40f5-9c67-6067512a6653 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:03.953024 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2ec6ef3f-2c17-40f5-9c67-6067512a6653 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:03.953465 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2ec6ef3f-2c17-40f5-9c67-6067512a6653 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:03.954158 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2ec6ef3f-2c17-40f5-9c67-6067512a6653 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:03.954609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2ec6ef3f-2c17-40f5-9c67-6067512a6653 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:03.955084 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2ec6ef3f-2c17-40f5-9c67-6067512a6653 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:04.097691 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-2ec6ef3f-2c17-40f5-9c67-6067512a6653 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:04.106394 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-2ec6ef3f-2c17-40f5-9c67-6067512a6653 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1364 microversion: 2.1 time: 0.165457 Aug 31 12:38:04.106700 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-a61dabd2-facc-4040-b5b0-9c00686bfbe4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:04.107438 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-a61dabd2-facc-4040-b5b0-9c00686bfbe4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 2256ff6f-c9cf-4d88-9453-6086f51f68dd] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:04.107538 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 385/778] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:03 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:04.113974 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a61dabd2-facc-4040-b5b0-9c00686bfbe4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:04.114466 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a61dabd2-facc-4040-b5b0-9c00686bfbe4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:04.114935 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a61dabd2-facc-4040-b5b0-9c00686bfbe4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:04.115923 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a61dabd2-facc-4040-b5b0-9c00686bfbe4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:04.116385 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a61dabd2-facc-4040-b5b0-9c00686bfbe4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:04.116808 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a61dabd2-facc-4040-b5b0-9c00686bfbe4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:04.271298 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-a61dabd2-facc-4040-b5b0-9c00686bfbe4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:04.280119 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-a61dabd2-facc-4040-b5b0-9c00686bfbe4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd" status: 200 len: 1314 microversion: 2.1 time: 0.179338 Aug 31 12:38:04.280703 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 394/779] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:04 2022] GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:04.426493 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-3f15a007-91d0-4b1d-a74a-cf6c1a844515 req-cc6c58e6-838c-4007-9149-34c47f90c795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2256ff6f-c9cf-4d88-9453-6086f51f68dd", "name": "network-vif-plugged", "status": "completed", "tag": "786dbde8-8b96-4aa1-939b-eb0e976c9e2f"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:38:04.437594 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-3f15a007-91d0-4b1d-a74a-cf6c1a844515 req-cc6c58e6-838c-4007-9149-34c47f90c795 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:04.437984 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-3f15a007-91d0-4b1d-a74a-cf6c1a844515 req-cc6c58e6-838c-4007-9149-34c47f90c795 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:04.438483 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-3f15a007-91d0-4b1d-a74a-cf6c1a844515 req-cc6c58e6-838c-4007-9149-34c47f90c795 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:04.455127 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-3f15a007-91d0-4b1d-a74a-cf6c1a844515 req-cc6c58e6-838c-4007-9149-34c47f90c795 service nova] Creating event network-vif-plugged:786dbde8-8b96-4aa1-939b-eb0e976c9e2f for instance 2256ff6f-c9cf-4d88-9453-6086f51f68dd on hv-cinder-85528 Aug 31 12:38:04.467601 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-3f15a007-91d0-4b1d-a74a-cf6c1a844515 req-cc6c58e6-838c-4007-9149-34c47f90c795 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044392 Aug 31 12:38:04.468784 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 386/780] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:38:05.137710 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-b060b996-262a-4dd8-a847-8157a7d93834 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:05.138322 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-b060b996-262a-4dd8-a847-8157a7d93834 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:05.144774 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b060b996-262a-4dd8-a847-8157a7d93834 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:05.145267 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b060b996-262a-4dd8-a847-8157a7d93834 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:05.145704 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b060b996-262a-4dd8-a847-8157a7d93834 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:05.146396 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b060b996-262a-4dd8-a847-8157a7d93834 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:05.146875 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b060b996-262a-4dd8-a847-8157a7d93834 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:05.147304 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b060b996-262a-4dd8-a847-8157a7d93834 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:05.302059 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-d1cb7d38-a378-4f4e-9225-8a204f7b41d8 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:05.302750 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-d1cb7d38-a378-4f4e-9225-8a204f7b41d8 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 2256ff6f-c9cf-4d88-9453-6086f51f68dd] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:05.308617 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-b060b996-262a-4dd8-a847-8157a7d93834 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:05.310691 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d1cb7d38-a378-4f4e-9225-8a204f7b41d8 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:05.311202 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d1cb7d38-a378-4f4e-9225-8a204f7b41d8 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:05.311631 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d1cb7d38-a378-4f4e-9225-8a204f7b41d8 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:05.312320 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d1cb7d38-a378-4f4e-9225-8a204f7b41d8 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:05.312767 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d1cb7d38-a378-4f4e-9225-8a204f7b41d8 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:05.313179 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d1cb7d38-a378-4f4e-9225-8a204f7b41d8 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:05.316779 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-b060b996-262a-4dd8-a847-8157a7d93834 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1364 microversion: 2.1 time: 0.183021 Aug 31 12:38:05.317649 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 395/781] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:05 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:05.456201 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-d1cb7d38-a378-4f4e-9225-8a204f7b41d8 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:05.464845 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-d1cb7d38-a378-4f4e-9225-8a204f7b41d8 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd" status: 200 len: 1314 microversion: 2.1 time: 0.167121 Aug 31 12:38:05.465397 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 387/782] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:05 2022] GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:06.343293 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-38632f9a-f1dd-4dc1-96b8-43e8295d0db5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:06.344579 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-38632f9a-f1dd-4dc1-96b8-43e8295d0db5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:06.356694 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-38632f9a-f1dd-4dc1-96b8-43e8295d0db5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:06.357941 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-38632f9a-f1dd-4dc1-96b8-43e8295d0db5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:06.358819 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-38632f9a-f1dd-4dc1-96b8-43e8295d0db5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:06.362895 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-38632f9a-f1dd-4dc1-96b8-43e8295d0db5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:06.363892 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-38632f9a-f1dd-4dc1-96b8-43e8295d0db5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:06.364554 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-38632f9a-f1dd-4dc1-96b8-43e8295d0db5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:06.499577 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-29b7aec0-1e5b-41cf-9e03-41c09a0e58a4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:06.501070 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-29b7aec0-1e5b-41cf-9e03-41c09a0e58a4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 2256ff6f-c9cf-4d88-9453-6086f51f68dd] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:06.513380 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-29b7aec0-1e5b-41cf-9e03-41c09a0e58a4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:06.514192 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-29b7aec0-1e5b-41cf-9e03-41c09a0e58a4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:06.515280 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-29b7aec0-1e5b-41cf-9e03-41c09a0e58a4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:06.516480 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-29b7aec0-1e5b-41cf-9e03-41c09a0e58a4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:06.517292 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-29b7aec0-1e5b-41cf-9e03-41c09a0e58a4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:06.518005 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-29b7aec0-1e5b-41cf-9e03-41c09a0e58a4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:06.526908 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=100 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:06.565390 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-38632f9a-f1dd-4dc1-96b8-43e8295d0db5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:06.575026 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-38632f9a-f1dd-4dc1-96b8-43e8295d0db5 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1364 microversion: 2.1 time: 0.239187 Aug 31 12:38:06.575984 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 396/783] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:06 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:06.582230 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-962708ef-a9c5-4eae-9ed1-2ad07a3a7b3a req-7a01831d-b572-44fe-9e7e-d58f17047bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0be9b94a-a5f6-4443-862e-e33f7a794c98", "name": "network-vif-plugged", "status": "completed", "tag": "18d85183-cc62-46fa-94cd-7d3b37300e7d"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:38:06.596192 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-962708ef-a9c5-4eae-9ed1-2ad07a3a7b3a req-7a01831d-b572-44fe-9e7e-d58f17047bb0 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:06.597050 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-962708ef-a9c5-4eae-9ed1-2ad07a3a7b3a req-7a01831d-b572-44fe-9e7e-d58f17047bb0 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:06.597918 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-962708ef-a9c5-4eae-9ed1-2ad07a3a7b3a req-7a01831d-b572-44fe-9e7e-d58f17047bb0 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:06.618447 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-962708ef-a9c5-4eae-9ed1-2ad07a3a7b3a req-7a01831d-b572-44fe-9e7e-d58f17047bb0 service nova] Creating event network-vif-plugged:18d85183-cc62-46fa-94cd-7d3b37300e7d for instance 0be9b94a-a5f6-4443-862e-e33f7a794c98 on hv-cinder-85528 Aug 31 12:38:06.628042 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-962708ef-a9c5-4eae-9ed1-2ad07a3a7b3a req-7a01831d-b572-44fe-9e7e-d58f17047bb0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049828 Aug 31 12:38:06.629315 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 397/784] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:38:06.647733 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-49df29f5-dcb4-438d-af50-412cba2e49fc tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:06.649135 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-49df29f5-dcb4-438d-af50-412cba2e49fc tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: 87f1b460-e745-4493-b38a-8a6ae3780e72] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:06.667051 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-49df29f5-dcb4-438d-af50-412cba2e49fc tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:06.668105 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-49df29f5-dcb4-438d-af50-412cba2e49fc tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:06.668872 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-49df29f5-dcb4-438d-af50-412cba2e49fc tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:06.670167 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-49df29f5-dcb4-438d-af50-412cba2e49fc tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:06.671365 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-49df29f5-dcb4-438d-af50-412cba2e49fc tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:06.672153 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-49df29f5-dcb4-438d-af50-412cba2e49fc tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:06.718455 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-49df29f5-dcb4-438d-af50-412cba2e49fc tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: 87f1b460-e745-4493-b38a-8a6ae3780e72] Going to try to terminate instance {{(pid=120749) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:38:06.718722 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-29b7aec0-1e5b-41cf-9e03-41c09a0e58a4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:06.733323 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-29b7aec0-1e5b-41cf-9e03-41c09a0e58a4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd" status: 200 len: 1497 microversion: 2.1 time: 0.242317 Aug 31 12:38:06.733803 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 388/785] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:06 2022] GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd => generated 1497 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:06.837642 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-49df29f5-dcb4-438d-af50-412cba2e49fc tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "DELETE /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72" status: 204 len: 0 microversion: 2.1 time: 0.201646 Aug 31 12:38:06.838527 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 398/786] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 31 12:38:06 2022] DELETE /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:38:06.851152 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-5fb7f3aa-5f84-4f76-b317-7b26700e78c7 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-713176309", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-280733761", "security_groups": [{"name": "tempest-secgroup-smoke-1147286286"}], "block_device_mapping_v2": [{"uuid": "86e361db-cf6f-4044-baff-2a542ff9b179", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bb498262-cecd-4350-a5a0-432fdf03b76c"}]}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:38:06.854709 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-00123529-ed0e-4719-8639-62a05f6a31d2 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:06.855463 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-00123529-ed0e-4719-8639-62a05f6a31d2 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: 87f1b460-e745-4493-b38a-8a6ae3780e72] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:06.862481 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-00123529-ed0e-4719-8639-62a05f6a31d2 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:06.863407 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-00123529-ed0e-4719-8639-62a05f6a31d2 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:06.864165 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-00123529-ed0e-4719-8639-62a05f6a31d2 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:06.865363 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-00123529-ed0e-4719-8639-62a05f6a31d2 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:06.866263 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-00123529-ed0e-4719-8639-62a05f6a31d2 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:06.866810 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-00123529-ed0e-4719-8639-62a05f6a31d2 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:06.991474 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.network.neutron [None req-5fb7f3aa-5f84-4f76-b317-7b26700e78c7 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] validate_networks() for [('bb498262-cecd-4350-a5a0-432fdf03b76c', None, None, None, None, None)] {{(pid=120750) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:38:07.061113 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-00123529-ed0e-4719-8639-62a05f6a31d2 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:07.071364 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-00123529-ed0e-4719-8639-62a05f6a31d2 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72" status: 200 len: 1511 microversion: 2.1 time: 0.226430 Aug 31 12:38:07.072926 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 399/787] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:06 2022] GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72 => generated 1511 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:07.287971 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-8d681aee-287c-41db-85b1-658d91e1bef3 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:07.288567 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-8d681aee-287c-41db-85b1-658d91e1bef3 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 2256ff6f-c9cf-4d88-9453-6086f51f68dd] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:07.294738 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8d681aee-287c-41db-85b1-658d91e1bef3 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:07.295266 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8d681aee-287c-41db-85b1-658d91e1bef3 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:07.295705 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8d681aee-287c-41db-85b1-658d91e1bef3 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:07.296405 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8d681aee-287c-41db-85b1-658d91e1bef3 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:07.296876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8d681aee-287c-41db-85b1-658d91e1bef3 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:07.297293 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8d681aee-287c-41db-85b1-658d91e1bef3 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:07.328208 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-8d681aee-287c-41db-85b1-658d91e1bef3 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 2256ff6f-c9cf-4d88-9453-6086f51f68dd] Going to try to terminate instance {{(pid=120749) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:38:07.408523 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-8d681aee-287c-41db-85b1-658d91e1bef3 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd" status: 204 len: 0 microversion: 2.1 time: 0.124091 Aug 31 12:38:07.409234 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 400/788] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 31 12:38:07 2022] DELETE /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 12:38:07.417625 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-4c80617f-8de0-4f5f-b74d-f0673b4aada4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:07.418313 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-4c80617f-8de0-4f5f-b74d-f0673b4aada4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 2256ff6f-c9cf-4d88-9453-6086f51f68dd] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:07.419183 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-5fb7f3aa-5f84-4f76-b317-7b26700e78c7 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Flavor limits 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:38:07.419626 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-5fb7f3aa-5f84-4f76-b317-7b26700e78c7 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Image limits 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:38:07.420099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-5fb7f3aa-5f84-4f76-b317-7b26700e78c7 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Flavor pref 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:38:07.420538 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-5fb7f3aa-5f84-4f76-b317-7b26700e78c7 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Image pref 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:38:07.420941 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-5fb7f3aa-5f84-4f76-b317-7b26700e78c7 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:38:07.424130 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4c80617f-8de0-4f5f-b74d-f0673b4aada4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:07.424608 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4c80617f-8de0-4f5f-b74d-f0673b4aada4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:07.425048 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4c80617f-8de0-4f5f-b74d-f0673b4aada4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:07.425717 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4c80617f-8de0-4f5f-b74d-f0673b4aada4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:07.426161 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4c80617f-8de0-4f5f-b74d-f0673b4aada4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:07.426572 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4c80617f-8de0-4f5f-b74d-f0673b4aada4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:07.429800 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5fb7f3aa-5f84-4f76-b317-7b26700e78c7 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:07.430431 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5fb7f3aa-5f84-4f76-b317-7b26700e78c7 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:07.430879 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5fb7f3aa-5f84-4f76-b317-7b26700e78c7 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:07.432349 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5fb7f3aa-5f84-4f76-b317-7b26700e78c7 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:07.432852 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5fb7f3aa-5f84-4f76-b317-7b26700e78c7 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:07.433317 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5fb7f3aa-5f84-4f76-b317-7b26700e78c7 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:07.450986 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-5fb7f3aa-5f84-4f76-b317-7b26700e78c7 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Getting quotas for project b364169c30154cc8af7c9a37bebc8040. Resources: {'cores', 'ram', 'instances'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:38:07.455113 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-5fb7f3aa-5f84-4f76-b317-7b26700e78c7 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Getting quotas for user 2e77671c123f434489d82da79212d0ab and project b364169c30154cc8af7c9a37bebc8040. Resources: {'cores', 'ram', 'instances'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:38:07.516449 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-5fb7f3aa-5f84-4f76-b317-7b26700e78c7 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Going to run 1 instances... {{(pid=120750) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:38:07.518585 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-5fb7f3aa-5f84-4f76-b317-7b26700e78c7 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='86e361db-cf6f-4044-baff-2a542ff9b179',volume_size=None,volume_type=None)] {{(pid=120750) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:38:07.574796 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-4c80617f-8de0-4f5f-b74d-f0673b4aada4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:07.582957 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-4c80617f-8de0-4f5f-b74d-f0673b4aada4 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd" status: 200 len: 1503 microversion: 2.1 time: 0.169440 Aug 31 12:38:07.583566 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 401/789] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:07 2022] GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:07.599457 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-b0344e06-534b-4acb-b7cb-3d11a499fffb tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:07.600199 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-b0344e06-534b-4acb-b7cb-3d11a499fffb tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:07.606890 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b0344e06-534b-4acb-b7cb-3d11a499fffb tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:07.607603 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b0344e06-534b-4acb-b7cb-3d11a499fffb tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:07.608265 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b0344e06-534b-4acb-b7cb-3d11a499fffb tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:07.608961 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b0344e06-534b-4acb-b7cb-3d11a499fffb tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:07.609640 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b0344e06-534b-4acb-b7cb-3d11a499fffb tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:07.610227 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b0344e06-534b-4acb-b7cb-3d11a499fffb tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:07.669945 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-5fb7f3aa-5f84-4f76-b317-7b26700e78c7 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.826141 Aug 31 12:38:07.676768 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 389/790] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 31 12:38:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:38:07.681857 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-e135ae84-9dbc-4ae3-8956-33ac7b276e3a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:07.682479 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-e135ae84-9dbc-4ae3-8956-33ac7b276e3a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:07.684456 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:07.759108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-e135ae84-9dbc-4ae3-8956-33ac7b276e3a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:07.762420 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-b0344e06-534b-4acb-b7cb-3d11a499fffb tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:07.767763 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-e135ae84-9dbc-4ae3-8956-33ac7b276e3a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d" status: 200 len: 1093 microversion: 2.1 time: 0.089821 Aug 31 12:38:07.768465 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 390/791] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:07 2022] GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d => generated 1093 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:07.772131 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-b0344e06-534b-4acb-b7cb-3d11a499fffb tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1364 microversion: 2.1 time: 0.178574 Aug 31 12:38:07.772766 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 402/792] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:07 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:08.099440 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-2a042258-d44f-4c94-adeb-de46c08b2a42 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:08.100029 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-2a042258-d44f-4c94-adeb-de46c08b2a42 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: 87f1b460-e745-4493-b38a-8a6ae3780e72] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:08.106253 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2a042258-d44f-4c94-adeb-de46c08b2a42 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:08.106732 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2a042258-d44f-4c94-adeb-de46c08b2a42 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:08.107186 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2a042258-d44f-4c94-adeb-de46c08b2a42 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:08.107867 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2a042258-d44f-4c94-adeb-de46c08b2a42 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:08.108309 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2a042258-d44f-4c94-adeb-de46c08b2a42 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:08.108723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2a042258-d44f-4c94-adeb-de46c08b2a42 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:08.524291 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-2a042258-d44f-4c94-adeb-de46c08b2a42 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:08.539174 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-2a042258-d44f-4c94-adeb-de46c08b2a42 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72" status: 200 len: 1511 microversion: 2.1 time: 0.443514 Aug 31 12:38:08.539774 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 391/793] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:08 2022] GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72 => generated 1511 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:08.605498 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-21213c63-842d-4528-8dae-fb05ad8363b6 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:08.606057 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-21213c63-842d-4528-8dae-fb05ad8363b6 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 2256ff6f-c9cf-4d88-9453-6086f51f68dd] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:08.612445 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-21213c63-842d-4528-8dae-fb05ad8363b6 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:08.612941 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-21213c63-842d-4528-8dae-fb05ad8363b6 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:08.613354 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-21213c63-842d-4528-8dae-fb05ad8363b6 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:08.614141 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-21213c63-842d-4528-8dae-fb05ad8363b6 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:08.614622 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-21213c63-842d-4528-8dae-fb05ad8363b6 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:08.615143 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-21213c63-842d-4528-8dae-fb05ad8363b6 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:08.755305 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-21213c63-842d-4528-8dae-fb05ad8363b6 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:08.763014 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-21213c63-842d-4528-8dae-fb05ad8363b6 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd" status: 200 len: 1503 microversion: 2.1 time: 0.162024 Aug 31 12:38:08.763579 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 403/794] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:08 2022] GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:08.795511 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-41ae7d4a-a03d-4679-a5c7-9997b010ec00 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:08.796246 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-41ae7d4a-a03d-4679-a5c7-9997b010ec00 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:08.796773 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-2bc2637d-b88f-49f2-aa7b-c8bfdad267c3 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:08.798122 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-2bc2637d-b88f-49f2-aa7b-c8bfdad267c3 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:08.803726 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-41ae7d4a-a03d-4679-a5c7-9997b010ec00 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:08.804822 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-41ae7d4a-a03d-4679-a5c7-9997b010ec00 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:08.805299 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2bc2637d-b88f-49f2-aa7b-c8bfdad267c3 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:08.805580 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-41ae7d4a-a03d-4679-a5c7-9997b010ec00 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:08.805803 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2bc2637d-b88f-49f2-aa7b-c8bfdad267c3 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:08.806861 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2bc2637d-b88f-49f2-aa7b-c8bfdad267c3 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:08.807192 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-41ae7d4a-a03d-4679-a5c7-9997b010ec00 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:08.807578 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2bc2637d-b88f-49f2-aa7b-c8bfdad267c3 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:08.807987 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-41ae7d4a-a03d-4679-a5c7-9997b010ec00 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:08.808096 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2bc2637d-b88f-49f2-aa7b-c8bfdad267c3 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:08.808446 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2bc2637d-b88f-49f2-aa7b-c8bfdad267c3 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:08.808698 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-41ae7d4a-a03d-4679-a5c7-9997b010ec00 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:08.883169 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-2bc2637d-b88f-49f2-aa7b-c8bfdad267c3 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:08.894762 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-2bc2637d-b88f-49f2-aa7b-c8bfdad267c3 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d" status: 200 len: 1143 microversion: 2.1 time: 0.101690 Aug 31 12:38:08.895840 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 404/795] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:08 2022] GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d => generated 1143 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:08.960534 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-41ae7d4a-a03d-4679-a5c7-9997b010ec00 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:08.969560 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-41ae7d4a-a03d-4679-a5c7-9997b010ec00 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1364 microversion: 2.1 time: 0.179563 Aug 31 12:38:08.970029 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 392/796] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:08 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:09.562113 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-4f689197-cea4-4b4e-ad08-d036dd5ea95c tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:09.562704 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-4f689197-cea4-4b4e-ad08-d036dd5ea95c tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: 87f1b460-e745-4493-b38a-8a6ae3780e72] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:09.568898 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4f689197-cea4-4b4e-ad08-d036dd5ea95c tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:09.569375 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4f689197-cea4-4b4e-ad08-d036dd5ea95c tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:09.569803 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4f689197-cea4-4b4e-ad08-d036dd5ea95c tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:09.570483 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4f689197-cea4-4b4e-ad08-d036dd5ea95c tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:09.570962 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4f689197-cea4-4b4e-ad08-d036dd5ea95c tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:09.571380 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4f689197-cea4-4b4e-ad08-d036dd5ea95c tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:09.772608 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-4f689197-cea4-4b4e-ad08-d036dd5ea95c tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:09.783842 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-31a40c81-0ba5-452b-aa09-c124dfdb393c tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:09.785847 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-31a40c81-0ba5-452b-aa09-c124dfdb393c tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 2256ff6f-c9cf-4d88-9453-6086f51f68dd] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:09.790271 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-4f689197-cea4-4b4e-ad08-d036dd5ea95c tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72" status: 200 len: 1511 microversion: 2.1 time: 0.232074 Aug 31 12:38:09.791413 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 405/797] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:09 2022] GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72 => generated 1511 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:09.793598 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-31a40c81-0ba5-452b-aa09-c124dfdb393c tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:09.794272 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-31a40c81-0ba5-452b-aa09-c124dfdb393c tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:09.794898 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-31a40c81-0ba5-452b-aa09-c124dfdb393c tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:09.795780 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-31a40c81-0ba5-452b-aa09-c124dfdb393c tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:09.796396 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-31a40c81-0ba5-452b-aa09-c124dfdb393c tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:09.796995 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-31a40c81-0ba5-452b-aa09-c124dfdb393c tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:09.919799 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-0b1045ba-2d07-4f9c-a3a9-030b2e961f3a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:09.920406 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-0b1045ba-2d07-4f9c-a3a9-030b2e961f3a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:09.926374 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0b1045ba-2d07-4f9c-a3a9-030b2e961f3a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:09.927092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0b1045ba-2d07-4f9c-a3a9-030b2e961f3a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:09.927528 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0b1045ba-2d07-4f9c-a3a9-030b2e961f3a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:09.928211 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0b1045ba-2d07-4f9c-a3a9-030b2e961f3a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:09.928829 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0b1045ba-2d07-4f9c-a3a9-030b2e961f3a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:09.929242 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0b1045ba-2d07-4f9c-a3a9-030b2e961f3a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:10.008710 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-0b1045ba-2d07-4f9c-a3a9-030b2e961f3a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:10.027458 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-0b1045ba-2d07-4f9c-a3a9-030b2e961f3a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d" status: 200 len: 1191 microversion: 2.1 time: 0.111214 Aug 31 12:38:10.045590 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 406/798] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:09 2022] GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d => generated 1191 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:10.050044 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-31a40c81-0ba5-452b-aa09-c124dfdb393c tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:10.050338 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-3d022382-dc4b-4e7a-812e-24ee57c1b5a2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:10.050970 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-3d022382-dc4b-4e7a-812e-24ee57c1b5a2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:10.068760 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-31a40c81-0ba5-452b-aa09-c124dfdb393c tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd" status: 200 len: 1503 microversion: 2.1 time: 0.288426 Aug 31 12:38:10.082211 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 393/799] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:09 2022] GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd => generated 1503 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:10.084147 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3d022382-dc4b-4e7a-812e-24ee57c1b5a2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:10.084690 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3d022382-dc4b-4e7a-812e-24ee57c1b5a2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:10.085134 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3d022382-dc4b-4e7a-812e-24ee57c1b5a2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:10.085852 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3d022382-dc4b-4e7a-812e-24ee57c1b5a2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:10.086314 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3d022382-dc4b-4e7a-812e-24ee57c1b5a2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:10.086743 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3d022382-dc4b-4e7a-812e-24ee57c1b5a2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:10.093289 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:10.324429 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-ffe1b091-266c-4d1f-a17a-782006897dfe req-85a64ca1-20ca-47b9-9a51-b582b6619476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2256ff6f-c9cf-4d88-9453-6086f51f68dd", "name": "network-vif-deleted", "tag": "786dbde8-8b96-4aa1-939b-eb0e976c9e2f"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:38:10.351520 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-ffe1b091-266c-4d1f-a17a-782006897dfe req-85a64ca1-20ca-47b9-9a51-b582b6619476 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:10.353492 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-ffe1b091-266c-4d1f-a17a-782006897dfe req-85a64ca1-20ca-47b9-9a51-b582b6619476 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:10.354176 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-ffe1b091-266c-4d1f-a17a-782006897dfe req-85a64ca1-20ca-47b9-9a51-b582b6619476 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:10.371296 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-ffe1b091-266c-4d1f-a17a-782006897dfe req-85a64ca1-20ca-47b9-9a51-b582b6619476 service nova] Creating event network-vif-deleted:786dbde8-8b96-4aa1-939b-eb0e976c9e2f for instance 2256ff6f-c9cf-4d88-9453-6086f51f68dd on hv-cinder-85528 Aug 31 12:38:10.381089 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-ffe1b091-266c-4d1f-a17a-782006897dfe req-85a64ca1-20ca-47b9-9a51-b582b6619476 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060768 Aug 31 12:38:10.383413 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 394/800] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:38:10.396381 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-bad5e124-284a-40ee-8f11-74ad2d5e2483 req-66505470-1a84-4de6-8ad1-f58ae0815124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87f1b460-e745-4493-b38a-8a6ae3780e72", "name": "network-vif-deleted", "tag": "f31716a0-6378-4919-bbe4-3fed724b2f58"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:38:10.405013 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-3d022382-dc4b-4e7a-812e-24ee57c1b5a2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:10.406948 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-bad5e124-284a-40ee-8f11-74ad2d5e2483 req-66505470-1a84-4de6-8ad1-f58ae0815124 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:10.407385 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-bad5e124-284a-40ee-8f11-74ad2d5e2483 req-66505470-1a84-4de6-8ad1-f58ae0815124 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:10.407833 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-bad5e124-284a-40ee-8f11-74ad2d5e2483 req-66505470-1a84-4de6-8ad1-f58ae0815124 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:10.413543 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-3d022382-dc4b-4e7a-812e-24ee57c1b5a2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1364 microversion: 2.1 time: 0.366704 Aug 31 12:38:10.414186 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 407/801] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:10 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1364 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:10.421009 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-bad5e124-284a-40ee-8f11-74ad2d5e2483 req-66505470-1a84-4de6-8ad1-f58ae0815124 service nova] Creating event network-vif-deleted:f31716a0-6378-4919-bbe4-3fed724b2f58 for instance 87f1b460-e745-4493-b38a-8a6ae3780e72 on hv-cinder-85528 Aug 31 12:38:10.425791 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-bad5e124-284a-40ee-8f11-74ad2d5e2483 req-66505470-1a84-4de6-8ad1-f58ae0815124 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040590 Aug 31 12:38:10.426635 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 395/802] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:38:10.817956 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-39ea6da4-7e54-40a5-8005-324e59104265 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:10.818563 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-39ea6da4-7e54-40a5-8005-324e59104265 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: 87f1b460-e745-4493-b38a-8a6ae3780e72] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:10.826090 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-39ea6da4-7e54-40a5-8005-324e59104265 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:10.826573 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-39ea6da4-7e54-40a5-8005-324e59104265 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:10.827035 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-39ea6da4-7e54-40a5-8005-324e59104265 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:10.827740 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-39ea6da4-7e54-40a5-8005-324e59104265 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:10.828204 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-39ea6da4-7e54-40a5-8005-324e59104265 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:10.828630 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-39ea6da4-7e54-40a5-8005-324e59104265 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:10.897891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-39ea6da4-7e54-40a5-8005-324e59104265 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:10.906352 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-39ea6da4-7e54-40a5-8005-324e59104265 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72" status: 200 len: 1303 microversion: 2.1 time: 0.092255 Aug 31 12:38:10.906929 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 408/803] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:10 2022] GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:11.049699 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-e6a61fb3-6b63-481a-81e5-a435c26de437 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:11.050456 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-e6a61fb3-6b63-481a-81e5-a435c26de437 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:11.057648 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e6a61fb3-6b63-481a-81e5-a435c26de437 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:11.058485 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e6a61fb3-6b63-481a-81e5-a435c26de437 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:11.058952 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e6a61fb3-6b63-481a-81e5-a435c26de437 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:11.059686 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e6a61fb3-6b63-481a-81e5-a435c26de437 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:11.060135 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e6a61fb3-6b63-481a-81e5-a435c26de437 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:11.060555 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e6a61fb3-6b63-481a-81e5-a435c26de437 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:11.093626 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-3f2b6fba-ff83-4493-adc8-812c5d4fa355 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:11.094948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-3f2b6fba-ff83-4493-adc8-812c5d4fa355 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 2256ff6f-c9cf-4d88-9453-6086f51f68dd] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:11.132495 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3f2b6fba-ff83-4493-adc8-812c5d4fa355 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:11.132997 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3f2b6fba-ff83-4493-adc8-812c5d4fa355 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:11.133437 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3f2b6fba-ff83-4493-adc8-812c5d4fa355 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:11.134190 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3f2b6fba-ff83-4493-adc8-812c5d4fa355 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:11.139418 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3f2b6fba-ff83-4493-adc8-812c5d4fa355 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:11.140411 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3f2b6fba-ff83-4493-adc8-812c5d4fa355 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:11.154795 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-e6a61fb3-6b63-481a-81e5-a435c26de437 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:11.165401 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-e6a61fb3-6b63-481a-81e5-a435c26de437 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d" status: 200 len: 1191 microversion: 2.1 time: 0.118763 Aug 31 12:38:11.167615 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 396/804] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:11 2022] GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d => generated 1191 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:11.190475 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:11.196576 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3f2b6fba-ff83-4493-adc8-812c5d4fa355 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:11.199116 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3f2b6fba-ff83-4493-adc8-812c5d4fa355 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:11.199610 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3f2b6fba-ff83-4493-adc8-812c5d4fa355 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:11.200064 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.objects.instance [None req-3f2b6fba-ff83-4493-adc8-812c5d4fa355 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lazy-loading 'fault' on Instance uuid 2256ff6f-c9cf-4d88-9453-6086f51f68dd {{(pid=120749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:38:11.267614 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-3f2b6fba-ff83-4493-adc8-812c5d4fa355 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:11.281222 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-3f2b6fba-ff83-4493-adc8-812c5d4fa355 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd" status: 200 len: 1304 microversion: 2.1 time: 0.191781 Aug 31 12:38:11.282875 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 409/805] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:11 2022] GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd => generated 1304 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:11.436652 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-a7838167-5314-49b0-838d-69846e3da8ff tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:11.437265 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-a7838167-5314-49b0-838d-69846e3da8ff tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:11.443617 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a7838167-5314-49b0-838d-69846e3da8ff tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:11.444126 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a7838167-5314-49b0-838d-69846e3da8ff tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:11.444561 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a7838167-5314-49b0-838d-69846e3da8ff tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:11.445250 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a7838167-5314-49b0-838d-69846e3da8ff tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:11.445703 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a7838167-5314-49b0-838d-69846e3da8ff tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:11.446153 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a7838167-5314-49b0-838d-69846e3da8ff tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:11.597788 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-a7838167-5314-49b0-838d-69846e3da8ff tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:11.607677 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-a7838167-5314-49b0-838d-69846e3da8ff tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1554 microversion: 2.1 time: 0.174821 Aug 31 12:38:11.608253 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 397/806] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:11 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:11.630823 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-edb1b038-0c04-4396-8e9f-5e407b8db443 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:11.631425 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-edb1b038-0c04-4396-8e9f-5e407b8db443 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:11.638171 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-edb1b038-0c04-4396-8e9f-5e407b8db443 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:11.638651 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-edb1b038-0c04-4396-8e9f-5e407b8db443 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:11.639109 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-edb1b038-0c04-4396-8e9f-5e407b8db443 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:11.639799 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-edb1b038-0c04-4396-8e9f-5e407b8db443 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:11.640294 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-edb1b038-0c04-4396-8e9f-5e407b8db443 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:11.640757 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-edb1b038-0c04-4396-8e9f-5e407b8db443 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:11.729871 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-edb1b038-0c04-4396-8e9f-5e407b8db443 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103178 Aug 31 12:38:11.730483 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 410/807] 10.222.0.79 () {58 vars in 1275 bytes} [Wed Aug 31 12:38:11 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:38:11.930624 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-5a98abff-dd1c-4de9-ace6-74c12ac3ef7e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:11.932396 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-5a98abff-dd1c-4de9-ace6-74c12ac3ef7e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: 87f1b460-e745-4493-b38a-8a6ae3780e72] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:11.940784 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5a98abff-dd1c-4de9-ace6-74c12ac3ef7e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:11.941650 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5a98abff-dd1c-4de9-ace6-74c12ac3ef7e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:11.942296 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5a98abff-dd1c-4de9-ace6-74c12ac3ef7e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:11.943372 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5a98abff-dd1c-4de9-ace6-74c12ac3ef7e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:11.944080 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5a98abff-dd1c-4de9-ace6-74c12ac3ef7e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:11.944722 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5a98abff-dd1c-4de9-ace6-74c12ac3ef7e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:11.999681 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5a98abff-dd1c-4de9-ace6-74c12ac3ef7e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:12.000668 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5a98abff-dd1c-4de9-ace6-74c12ac3ef7e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:12.001181 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5a98abff-dd1c-4de9-ace6-74c12ac3ef7e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:12.001771 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.objects.instance [None req-5a98abff-dd1c-4de9-ace6-74c12ac3ef7e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lazy-loading 'fault' on Instance uuid 87f1b460-e745-4493-b38a-8a6ae3780e72 {{(pid=120750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:38:12.048533 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-5a98abff-dd1c-4de9-ace6-74c12ac3ef7e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:12.055953 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-5a98abff-dd1c-4de9-ace6-74c12ac3ef7e tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72" status: 200 len: 1308 microversion: 2.1 time: 0.129936 Aug 31 12:38:12.070947 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 398/808] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:11 2022] GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72 => generated 1308 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:12.189448 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-e987f3f0-d550-401a-a745-5d6e5e4dfd8c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:12.189983 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-e987f3f0-d550-401a-a745-5d6e5e4dfd8c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:12.196735 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e987f3f0-d550-401a-a745-5d6e5e4dfd8c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:12.197366 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e987f3f0-d550-401a-a745-5d6e5e4dfd8c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:12.197804 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e987f3f0-d550-401a-a745-5d6e5e4dfd8c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:12.198559 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e987f3f0-d550-401a-a745-5d6e5e4dfd8c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:12.198996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e987f3f0-d550-401a-a745-5d6e5e4dfd8c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:12.199430 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e987f3f0-d550-401a-a745-5d6e5e4dfd8c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:12.305457 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-3dbe6607-4d45-452c-afd9-e24324eec984 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:12.306176 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-3dbe6607-4d45-452c-afd9-e24324eec984 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 2256ff6f-c9cf-4d88-9453-6086f51f68dd] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:12.307263 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-e987f3f0-d550-401a-a745-5d6e5e4dfd8c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:12.313516 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3dbe6607-4d45-452c-afd9-e24324eec984 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:12.314329 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3dbe6607-4d45-452c-afd9-e24324eec984 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:12.315059 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3dbe6607-4d45-452c-afd9-e24324eec984 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:12.315292 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-e987f3f0-d550-401a-a745-5d6e5e4dfd8c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d" status: 200 len: 1197 microversion: 2.1 time: 0.130235 Aug 31 12:38:12.315903 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 411/809] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:12 2022] GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d => generated 1197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:12.329175 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3dbe6607-4d45-452c-afd9-e24324eec984 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:12.329175 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3dbe6607-4d45-452c-afd9-e24324eec984 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:12.329175 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3dbe6607-4d45-452c-afd9-e24324eec984 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:12.332354 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-3dbe6607-4d45-452c-afd9-e24324eec984 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] HTTP exception thrown: Instance 2256ff6f-c9cf-4d88-9453-6086f51f68dd could not be found. Aug 31 12:38:12.334057 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-3dbe6607-4d45-452c-afd9-e24324eec984 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Request method failure captured: Aug 31 12:38:12.334057 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd HTTP/1.1 Aug 31 12:38:12.334057 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:38:12.334057 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:38:12.334057 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:38:12.334057 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 0 Aug 31 12:38:12.334057 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:38:12.334057 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:38:12.334057 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:38:12.334057 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:38:12.334057 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1YX4jpSs_XHpUZ57T3LhL9NU02d1e3uenSdFREQ039IJwwXo-WERwcYc8ohTbwhaENEu34gfgoSy5_AdMLCTvraK23ojowXhUFhMeHPwyMRba7u4LMe_DRd5dBAvTEpEJR6J4gvD6tKVjqsMcQ35MMqEfVw2-b2KAYHyMnyk14Sy-U Aug 31 12:38:12.334057 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:38:12.334057 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:38:12.334057 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:38:12.334057 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:38:12.334057 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:38:12.334057 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:38:12.334057 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: c5c8e3638b084b768d8ba4b0202af99d Aug 31 12:38:12.334057 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-VolumesActionsTest-658817297 Aug 31 12:38:12.334057 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:38:12.334057 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:38:12.335556 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c5c8e3638b084b768d8ba4b0202af99d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c5c8e3638b084b768d8ba4b0202af99d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c5c8e3638b084b768d8ba4b0202af99d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c5c8e3638b084b768d8ba4b0202af99d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:38:12.335556 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-VolumesActionsTest-658817297 Aug 31 12:38:12.335556 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: c5c8e3638b084b768d8ba4b0202af99d Aug 31 12:38:12.335556 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-VolumesActionsTest-658817297 Aug 31 12:38:12.335556 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-VolumesActionsTest-658817297-project Aug 31 12:38:12.335556 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:38:12.335556 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:38:12.335556 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: b4ca778b2f2f45c29cc99cbbe190d76a Aug 31 12:38:12.335556 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-VolumesActionsTest-658817297-project Aug 31 12:38:12.335556 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:38:12.335556 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Instance 2256ff6f-c9cf-4d88-9453-6086f51f68dd could not be found. Aug 31 12:38:12.335556 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'id': '2256ff6f-c9cf-4d88-9453-6086f51f68dd'} Aug 31 12:38:12.336386 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:38:12.336386 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:38:12.336386 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:38:12.336386 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:38:12.336386 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:38:12.336386 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:38:12.336386 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:38:12.336386 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:38:12.336386 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:38:12.336386 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:38:12.336386 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2256ff6f-c9cf-4d88-9453-6086f51f68dd could not be found. Aug 31 12:38:12.336386 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:38:12.336386 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:38:12.336386 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:38:12.336386 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:38:12.336386 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:38:12.336386 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:38:12.336386 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:38:12.336386 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:38:12.336386 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:38:12.338745 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:38:12.338745 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:38:12.338745 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:38:12.338745 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:38:12.338745 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:38:12.338745 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:38:12.338745 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:38:12.338745 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2256ff6f-c9cf-4d88-9453-6086f51f68dd could not be found. Aug 31 12:38:12.338745 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:38:12.338745 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:38:12.338745 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:38:12.338745 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:38:12.338745 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:38:12.338745 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:38:12.338745 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:38:12.338745 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:38:12.338745 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2256ff6f-c9cf-4d88-9453-6086f51f68dd could not be found. Aug 31 12:38:12.338745 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:38:12.340047 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-3dbe6607-4d45-452c-afd9-e24324eec984 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Returning 404 to user: Instance 2256ff6f-c9cf-4d88-9453-6086f51f68dd could not be found. {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:38:12.340047 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-3dbe6607-4d45-452c-afd9-e24324eec984 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd" status: 404 len: 111 microversion: 2.1 time: 0.034564 Aug 31 12:38:12.340047 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 399/810] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:12 2022] GET /compute/v2.1/servers/2256ff6f-c9cf-4d88-9453-6086f51f68dd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 12:38:12.391703 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-cd4310fa-7fb7-4f5c-b341-83fec458aa24 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-210758675", "imageRef": "2aaf4ebd-395b-468e-bb6b-c663d01edea0", "flavorRef": "452", "networks": [{"uuid": "11e9fd5d-01c8-4616-bf01-2803d4e9694e"}]}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:38:12.451133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.network.neutron [None req-cd4310fa-7fb7-4f5c-b341-83fec458aa24 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] validate_networks() for [('11e9fd5d-01c8-4616-bf01-2803d4e9694e', None, None, None, None, None)] {{(pid=120749) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:38:13.078122 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-bf6d189d-748d-4028-9243-3912fa414f32 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:13.078728 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-bf6d189d-748d-4028-9243-3912fa414f32 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: 87f1b460-e745-4493-b38a-8a6ae3780e72] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:13.085599 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bf6d189d-748d-4028-9243-3912fa414f32 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:13.086100 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bf6d189d-748d-4028-9243-3912fa414f32 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:13.086536 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bf6d189d-748d-4028-9243-3912fa414f32 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:13.087295 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bf6d189d-748d-4028-9243-3912fa414f32 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:13.087768 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bf6d189d-748d-4028-9243-3912fa414f32 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:13.088192 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bf6d189d-748d-4028-9243-3912fa414f32 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:13.102522 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-bf6d189d-748d-4028-9243-3912fa414f32 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] HTTP exception thrown: Instance 87f1b460-e745-4493-b38a-8a6ae3780e72 could not be found. Aug 31 12:38:13.104772 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-bf6d189d-748d-4028-9243-3912fa414f32 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Request method failure captured: Aug 31 12:38:13.104772 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72 HTTP/1.1 Aug 31 12:38:13.104772 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:38:13.104772 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:38:13.104772 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:38:13.104772 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 0 Aug 31 12:38:13.104772 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:38:13.104772 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:38:13.104772 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:38:13.104772 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:38:13.104772 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1XxboPZzp65tORq6hJVVJ8JvLJkmkZfou7DPF9xedLUXtV6L3OOoAhiNig1BLzpjsTgi5vqXluMvrmov3HNRRs-1GMopOlE7Y2OSghOAkbHHkfIigRKM7lVEN60Uf7u_R4b7iIjl8qsiv-D9sNb7W3l1hW5dxJ4C8vqz-Q45XRyaOs Aug 31 12:38:13.104772 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:38:13.104772 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:38:13.104772 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:38:13.104772 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:38:13.104772 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:38:13.104772 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:38:13.104772 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: 812b75d0fa3241d38b2727efe253ca20 Aug 31 12:38:13.104772 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1946876077 Aug 31 12:38:13.104772 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:38:13.104772 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:38:13.106226 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/812b75d0fa3241d38b2727efe253ca20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_812b75d0fa3241d38b2727efe253ca20", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/812b75d0fa3241d38b2727efe253ca20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/812b75d0fa3241d38b2727efe253ca20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:38:13.106226 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-VolumesSnapshotTestJSON-1946876077 Aug 31 12:38:13.106226 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: 812b75d0fa3241d38b2727efe253ca20 Aug 31 12:38:13.106226 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1946876077 Aug 31 12:38:13.106226 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-VolumesSnapshotTestJSON-1946876077-project Aug 31 12:38:13.106226 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:38:13.106226 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:38:13.106226 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: c4fb81a9221d435a8d9e38ab138cad4a Aug 31 12:38:13.106226 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-VolumesSnapshotTestJSON-1946876077-project Aug 31 12:38:13.106226 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:38:13.106226 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Instance 87f1b460-e745-4493-b38a-8a6ae3780e72 could not be found. Aug 31 12:38:13.106226 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'id': '87f1b460-e745-4493-b38a-8a6ae3780e72'} Aug 31 12:38:13.107125 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:38:13.107125 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:38:13.107125 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:38:13.107125 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:38:13.107125 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:38:13.107125 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:38:13.107125 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:38:13.107125 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:38:13.107125 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:38:13.107125 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:38:13.107125 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87f1b460-e745-4493-b38a-8a6ae3780e72 could not be found. Aug 31 12:38:13.107125 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:38:13.107125 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:38:13.107125 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:38:13.107125 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:38:13.107125 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:38:13.107125 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:38:13.107125 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:38:13.107125 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:38:13.107125 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:38:13.108419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:38:13.108419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:38:13.108419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:38:13.108419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:38:13.108419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:38:13.108419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:38:13.108419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:38:13.108419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87f1b460-e745-4493-b38a-8a6ae3780e72 could not be found. Aug 31 12:38:13.108419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:38:13.108419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:38:13.108419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:38:13.108419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:38:13.108419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:38:13.108419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:38:13.108419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:38:13.108419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:38:13.108419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87f1b460-e745-4493-b38a-8a6ae3780e72 could not be found. Aug 31 12:38:13.108419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:38:13.109577 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-bf6d189d-748d-4028-9243-3912fa414f32 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Returning 404 to user: Instance 87f1b460-e745-4493-b38a-8a6ae3780e72 could not be found. {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:38:13.109577 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-bf6d189d-748d-4028-9243-3912fa414f32 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72" status: 404 len: 111 microversion: 2.1 time: 0.032061 Aug 31 12:38:13.109577 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 400/811] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:13 2022] GET /compute/v2.1/servers/87f1b460-e745-4493-b38a-8a6ae3780e72 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 12:38:13.338135 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-f0307d6c-eb89-42b5-8b7e-433645061977 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:13.338786 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-f0307d6c-eb89-42b5-8b7e-433645061977 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:13.345950 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f0307d6c-eb89-42b5-8b7e-433645061977 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:13.346676 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f0307d6c-eb89-42b5-8b7e-433645061977 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:13.347146 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f0307d6c-eb89-42b5-8b7e-433645061977 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:13.347853 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f0307d6c-eb89-42b5-8b7e-433645061977 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:13.348515 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f0307d6c-eb89-42b5-8b7e-433645061977 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:13.349104 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f0307d6c-eb89-42b5-8b7e-433645061977 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:13.513896 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f0307d6c-eb89-42b5-8b7e-433645061977 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:13.521877 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-f0307d6c-eb89-42b5-8b7e-433645061977 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d" status: 200 len: 1265 microversion: 2.1 time: 0.188775 Aug 31 12:38:13.522513 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 401/812] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:13 2022] GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:13.593125 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-cd4310fa-7fb7-4f5c-b341-83fec458aa24 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Flavor limits 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:38:13.593703 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-cd4310fa-7fb7-4f5c-b341-83fec458aa24 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Image limits 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:38:13.593997 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-cd4310fa-7fb7-4f5c-b341-83fec458aa24 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Flavor pref 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:38:13.594398 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-cd4310fa-7fb7-4f5c-b341-83fec458aa24 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Image pref 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:38:13.594809 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-cd4310fa-7fb7-4f5c-b341-83fec458aa24 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:38:13.605359 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cd4310fa-7fb7-4f5c-b341-83fec458aa24 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:13.605947 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cd4310fa-7fb7-4f5c-b341-83fec458aa24 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:13.606380 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cd4310fa-7fb7-4f5c-b341-83fec458aa24 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:13.607183 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cd4310fa-7fb7-4f5c-b341-83fec458aa24 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:13.607639 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cd4310fa-7fb7-4f5c-b341-83fec458aa24 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:13.608057 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cd4310fa-7fb7-4f5c-b341-83fec458aa24 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:13.631996 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-cd4310fa-7fb7-4f5c-b341-83fec458aa24 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Getting quotas for project c5c8e3638b084b768d8ba4b0202af99d. Resources: {'cores', 'ram', 'instances'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:38:13.636457 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-cd4310fa-7fb7-4f5c-b341-83fec458aa24 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Getting quotas for user b4ca778b2f2f45c29cc99cbbe190d76a and project c5c8e3638b084b768d8ba4b0202af99d. Resources: {'cores', 'ram', 'instances'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:38:13.649618 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-cd4310fa-7fb7-4f5c-b341-83fec458aa24 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Going to run 1 instances... {{(pid=120749) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:38:13.653012 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-cd4310fa-7fb7-4f5c-b341-83fec458aa24 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 9343f4c4-7546-42a6-91ea-8f441996771c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aaf4ebd-395b-468e-bb6b-c663d01edea0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:38:13.711373 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-cd4310fa-7fb7-4f5c-b341-83fec458aa24 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.323810 Aug 31 12:38:13.712021 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 412/813] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 31 12:38:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:38:13.725381 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-9b5ab132-bf85-4fdb-abfd-3f7a534e924f tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:13.726567 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-9b5ab132-bf85-4fdb-abfd-3f7a534e924f tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 9343f4c4-7546-42a6-91ea-8f441996771c] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:13.795308 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-2dd59de5-44ae-4516-bc12-c14dd66460db req-da1af613-6da6-41f5-bc4f-5e4f0a932e50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0be9b94a-a5f6-4443-862e-e33f7a794c98", "tag": "18d85183-cc62-46fa-94cd-7d3b37300e7d"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:38:13.807886 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-9b5ab132-bf85-4fdb-abfd-3f7a534e924f tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:13.814681 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-2dd59de5-44ae-4516-bc12-c14dd66460db req-da1af613-6da6-41f5-bc4f-5e4f0a932e50 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:13.815198 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-2dd59de5-44ae-4516-bc12-c14dd66460db req-da1af613-6da6-41f5-bc4f-5e4f0a932e50 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:13.815748 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-2dd59de5-44ae-4516-bc12-c14dd66460db req-da1af613-6da6-41f5-bc4f-5e4f0a932e50 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:13.816250 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-9b5ab132-bf85-4fdb-abfd-3f7a534e924f tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c" status: 200 len: 1213 microversion: 2.1 time: 0.096229 Aug 31 12:38:13.830275 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 402/814] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:13 2022] GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:13.830637 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-2dd59de5-44ae-4516-bc12-c14dd66460db req-da1af613-6da6-41f5-bc4f-5e4f0a932e50 service nova] Creating event network-changed:18d85183-cc62-46fa-94cd-7d3b37300e7d for instance 0be9b94a-a5f6-4443-862e-e33f7a794c98 on hv-cinder-85528 Aug 31 12:38:13.835890 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-2dd59de5-44ae-4516-bc12-c14dd66460db req-da1af613-6da6-41f5-bc4f-5e4f0a932e50 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046513 Aug 31 12:38:13.836511 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 413/815] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:38:14.544728 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-79a0e8eb-b48a-47d4-a76b-3d9893f04c19 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:14.545596 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-79a0e8eb-b48a-47d4-a76b-3d9893f04c19 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:14.554988 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-79a0e8eb-b48a-47d4-a76b-3d9893f04c19 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:14.555929 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-79a0e8eb-b48a-47d4-a76b-3d9893f04c19 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:14.556393 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-79a0e8eb-b48a-47d4-a76b-3d9893f04c19 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:14.557342 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-79a0e8eb-b48a-47d4-a76b-3d9893f04c19 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:14.558764 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-79a0e8eb-b48a-47d4-a76b-3d9893f04c19 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:14.559460 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-79a0e8eb-b48a-47d4-a76b-3d9893f04c19 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:14.745747 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-79a0e8eb-b48a-47d4-a76b-3d9893f04c19 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:14.755254 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-79a0e8eb-b48a-47d4-a76b-3d9893f04c19 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d" status: 200 len: 1265 microversion: 2.1 time: 0.214849 Aug 31 12:38:14.757737 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 403/816] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:14 2022] GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:14.842964 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-0a4158e4-04ae-45e8-aeed-f009f6bfa78a tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:14.843804 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-0a4158e4-04ae-45e8-aeed-f009f6bfa78a tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 9343f4c4-7546-42a6-91ea-8f441996771c] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:14.852666 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0a4158e4-04ae-45e8-aeed-f009f6bfa78a tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:14.853340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0a4158e4-04ae-45e8-aeed-f009f6bfa78a tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:14.853877 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0a4158e4-04ae-45e8-aeed-f009f6bfa78a tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:14.854878 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0a4158e4-04ae-45e8-aeed-f009f6bfa78a tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:14.855431 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0a4158e4-04ae-45e8-aeed-f009f6bfa78a tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:14.855928 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0a4158e4-04ae-45e8-aeed-f009f6bfa78a tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:14.951914 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-0a4158e4-04ae-45e8-aeed-f009f6bfa78a tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:14.966595 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-0a4158e4-04ae-45e8-aeed-f009f6bfa78a tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c" status: 200 len: 1217 microversion: 2.1 time: 0.130572 Aug 31 12:38:14.967531 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 414/817] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:14 2022] GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c => generated 1217 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:15.784929 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-8dddf1de-5980-4974-8537-cc4b972ef2ce tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:15.785490 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-8dddf1de-5980-4974-8537-cc4b972ef2ce tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:15.793124 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8dddf1de-5980-4974-8537-cc4b972ef2ce tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:15.793617 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8dddf1de-5980-4974-8537-cc4b972ef2ce tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:15.794044 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8dddf1de-5980-4974-8537-cc4b972ef2ce tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:15.794745 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8dddf1de-5980-4974-8537-cc4b972ef2ce tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:15.795224 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8dddf1de-5980-4974-8537-cc4b972ef2ce tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:15.795642 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8dddf1de-5980-4974-8537-cc4b972ef2ce tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:15.941585 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-8dddf1de-5980-4974-8537-cc4b972ef2ce tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:15.951158 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-8dddf1de-5980-4974-8537-cc4b972ef2ce tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d" status: 200 len: 1265 microversion: 2.1 time: 0.170115 Aug 31 12:38:15.951743 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 404/818] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:15 2022] GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:15.987806 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-ebcc2b21-ed47-4de0-8372-4ede9eed632b tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:15.988423 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-ebcc2b21-ed47-4de0-8372-4ede9eed632b tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 9343f4c4-7546-42a6-91ea-8f441996771c] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:15.995907 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ebcc2b21-ed47-4de0-8372-4ede9eed632b tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:15.996390 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ebcc2b21-ed47-4de0-8372-4ede9eed632b tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:15.996813 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ebcc2b21-ed47-4de0-8372-4ede9eed632b tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:15.997500 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ebcc2b21-ed47-4de0-8372-4ede9eed632b tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:15.997943 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ebcc2b21-ed47-4de0-8372-4ede9eed632b tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:15.998362 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ebcc2b21-ed47-4de0-8372-4ede9eed632b tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:16.063937 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-ebcc2b21-ed47-4de0-8372-4ede9eed632b tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:16.073229 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-ebcc2b21-ed47-4de0-8372-4ede9eed632b tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c" status: 200 len: 1217 microversion: 2.1 time: 0.089157 Aug 31 12:38:16.073831 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 415/819] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:15 2022] GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:16.972147 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-afecda08-f85f-4554-b6b6-c894f90467e0 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:16.973658 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-afecda08-f85f-4554-b6b6-c894f90467e0 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:16.984263 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-afecda08-f85f-4554-b6b6-c894f90467e0 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:16.984815 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-afecda08-f85f-4554-b6b6-c894f90467e0 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:16.985341 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-afecda08-f85f-4554-b6b6-c894f90467e0 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:16.986531 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-afecda08-f85f-4554-b6b6-c894f90467e0 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:16.987077 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-afecda08-f85f-4554-b6b6-c894f90467e0 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:16.987568 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-afecda08-f85f-4554-b6b6-c894f90467e0 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:17.095058 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-5ad02eb2-b52c-4dfa-b927-68ba610b4b5d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:17.096292 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-5ad02eb2-b52c-4dfa-b927-68ba610b4b5d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 9343f4c4-7546-42a6-91ea-8f441996771c] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:17.104160 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5ad02eb2-b52c-4dfa-b927-68ba610b4b5d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:17.104947 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5ad02eb2-b52c-4dfa-b927-68ba610b4b5d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:17.105587 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5ad02eb2-b52c-4dfa-b927-68ba610b4b5d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:17.106474 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5ad02eb2-b52c-4dfa-b927-68ba610b4b5d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:17.107136 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5ad02eb2-b52c-4dfa-b927-68ba610b4b5d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:17.107561 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5ad02eb2-b52c-4dfa-b927-68ba610b4b5d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:17.195503 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-afecda08-f85f-4554-b6b6-c894f90467e0 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:17.196356 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-5ad02eb2-b52c-4dfa-b927-68ba610b4b5d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:17.209655 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-5ad02eb2-b52c-4dfa-b927-68ba610b4b5d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c" status: 200 len: 1265 microversion: 2.1 time: 0.118387 Aug 31 12:38:17.209823 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-afecda08-f85f-4554-b6b6-c894f90467e0 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d" status: 200 len: 1265 microversion: 2.1 time: 0.238223 Aug 31 12:38:17.210439 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 405/820] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:16 2022] GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:17.211490 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 416/821] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:17 2022] GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c => generated 1265 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:17.253234 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-8585a7e4-0daa-42ca-83d7-243e3901c4c5 req-e731efb3-003f-41d1-a30e-010d0886f107 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a96c4a7-b50c-48dc-97be-91c9aae4fc3d", "tag": "a4a552df-b84c-41d7-b76b-420c62afae50"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:38:17.269092 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-8585a7e4-0daa-42ca-83d7-243e3901c4c5 req-e731efb3-003f-41d1-a30e-010d0886f107 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:17.269926 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-8585a7e4-0daa-42ca-83d7-243e3901c4c5 req-e731efb3-003f-41d1-a30e-010d0886f107 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:17.270929 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-8585a7e4-0daa-42ca-83d7-243e3901c4c5 req-e731efb3-003f-41d1-a30e-010d0886f107 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:17.285453 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-8585a7e4-0daa-42ca-83d7-243e3901c4c5 req-e731efb3-003f-41d1-a30e-010d0886f107 service nova] Creating event network-changed:a4a552df-b84c-41d7-b76b-420c62afae50 for instance 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d on hv-cinder-85528 Aug 31 12:38:17.291762 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-8585a7e4-0daa-42ca-83d7-243e3901c4c5 req-e731efb3-003f-41d1-a30e-010d0886f107 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043166 Aug 31 12:38:17.292979 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 406/822] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:38:18.238452 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-224fe36b-ff6a-412b-b36f-0da8f713809c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:18.239161 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-57506284-7763-4a06-8317-c6d1621f667f tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:18.239161 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-57506284-7763-4a06-8317-c6d1621f667f tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 9343f4c4-7546-42a6-91ea-8f441996771c] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:18.239662 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-224fe36b-ff6a-412b-b36f-0da8f713809c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:18.239764 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell0:SELECT=2 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:18.249831 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-57506284-7763-4a06-8317-c6d1621f667f tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:18.250564 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-57506284-7763-4a06-8317-c6d1621f667f tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:18.251396 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-57506284-7763-4a06-8317-c6d1621f667f tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:18.251551 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-224fe36b-ff6a-412b-b36f-0da8f713809c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:18.252013 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-224fe36b-ff6a-412b-b36f-0da8f713809c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:18.252447 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-224fe36b-ff6a-412b-b36f-0da8f713809c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:18.252881 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-57506284-7763-4a06-8317-c6d1621f667f tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:18.253147 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-224fe36b-ff6a-412b-b36f-0da8f713809c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:18.253597 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-224fe36b-ff6a-412b-b36f-0da8f713809c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:18.253962 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-57506284-7763-4a06-8317-c6d1621f667f tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:18.254086 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-224fe36b-ff6a-412b-b36f-0da8f713809c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:18.254678 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-57506284-7763-4a06-8317-c6d1621f667f tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:18.517421 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-224fe36b-ff6a-412b-b36f-0da8f713809c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:18.528262 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-224fe36b-ff6a-412b-b36f-0da8f713809c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d" status: 200 len: 1265 microversion: 2.1 time: 0.300457 Aug 31 12:38:18.529066 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 417/823] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:18 2022] GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d => generated 1265 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:18.544148 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-57506284-7763-4a06-8317-c6d1621f667f tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:18.563943 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-57506284-7763-4a06-8317-c6d1621f667f tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c" status: 200 len: 1313 microversion: 2.1 time: 0.335942 Aug 31 12:38:18.579436 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 407/824] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:18 2022] GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:18.923463 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-77469f19-7c45-4b16-89c3-6297fd2f4ea1 req-235b01e0-da17-4c6b-ac9b-37138ffd78f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9343f4c4-7546-42a6-91ea-8f441996771c", "tag": "3070f264-9903-4a87-b647-483d6174d428"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:38:18.939560 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-77469f19-7c45-4b16-89c3-6297fd2f4ea1 req-235b01e0-da17-4c6b-ac9b-37138ffd78f2 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:18.940037 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-77469f19-7c45-4b16-89c3-6297fd2f4ea1 req-235b01e0-da17-4c6b-ac9b-37138ffd78f2 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:18.940671 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-77469f19-7c45-4b16-89c3-6297fd2f4ea1 req-235b01e0-da17-4c6b-ac9b-37138ffd78f2 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:18.971315 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-77469f19-7c45-4b16-89c3-6297fd2f4ea1 req-235b01e0-da17-4c6b-ac9b-37138ffd78f2 service nova] Creating event network-changed:3070f264-9903-4a87-b647-483d6174d428 for instance 9343f4c4-7546-42a6-91ea-8f441996771c on hv-cinder-85528 Aug 31 12:38:18.984407 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-77469f19-7c45-4b16-89c3-6297fd2f4ea1 req-235b01e0-da17-4c6b-ac9b-37138ffd78f2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063844 Aug 31 12:38:18.985485 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 418/825] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:38:19.550578 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-0a95d8cb-c75b-4b89-9557-23ebfb7da97c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:19.551334 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-0a95d8cb-c75b-4b89-9557-23ebfb7da97c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:19.559528 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0a95d8cb-c75b-4b89-9557-23ebfb7da97c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:19.560019 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0a95d8cb-c75b-4b89-9557-23ebfb7da97c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:19.560454 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0a95d8cb-c75b-4b89-9557-23ebfb7da97c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:19.561160 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0a95d8cb-c75b-4b89-9557-23ebfb7da97c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:19.561759 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0a95d8cb-c75b-4b89-9557-23ebfb7da97c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:19.562013 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0a95d8cb-c75b-4b89-9557-23ebfb7da97c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:19.588528 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-c1533e8b-6b01-440e-9c2e-80808454210d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:19.589222 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-c1533e8b-6b01-440e-9c2e-80808454210d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 9343f4c4-7546-42a6-91ea-8f441996771c] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:19.595891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c1533e8b-6b01-440e-9c2e-80808454210d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:19.596387 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c1533e8b-6b01-440e-9c2e-80808454210d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:19.596819 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c1533e8b-6b01-440e-9c2e-80808454210d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:19.598045 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c1533e8b-6b01-440e-9c2e-80808454210d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:19.598769 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c1533e8b-6b01-440e-9c2e-80808454210d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:19.599332 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c1533e8b-6b01-440e-9c2e-80808454210d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:19.713381 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-0a95d8cb-c75b-4b89-9557-23ebfb7da97c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:19.723968 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-0a95d8cb-c75b-4b89-9557-23ebfb7da97c tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d" status: 200 len: 1265 microversion: 2.1 time: 0.177504 Aug 31 12:38:19.725267 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 408/826] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:19 2022] GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:19.765372 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-c1533e8b-6b01-440e-9c2e-80808454210d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:19.774103 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-c1533e8b-6b01-440e-9c2e-80808454210d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c" status: 200 len: 1313 microversion: 2.1 time: 0.190046 Aug 31 12:38:19.774690 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 419/827] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:19 2022] GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:20.756279 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-9b355e37-07aa-4bba-ba0d-cdbe81359f22 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:20.757266 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-9b355e37-07aa-4bba-ba0d-cdbe81359f22 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:20.764572 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9b355e37-07aa-4bba-ba0d-cdbe81359f22 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:20.765061 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9b355e37-07aa-4bba-ba0d-cdbe81359f22 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:20.765489 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9b355e37-07aa-4bba-ba0d-cdbe81359f22 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:20.766185 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9b355e37-07aa-4bba-ba0d-cdbe81359f22 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:20.766631 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9b355e37-07aa-4bba-ba0d-cdbe81359f22 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:20.767083 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9b355e37-07aa-4bba-ba0d-cdbe81359f22 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:20.796166 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-d12bbb5e-0b5e-41de-a907-f3faeb943d66 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:20.797025 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-d12bbb5e-0b5e-41de-a907-f3faeb943d66 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 9343f4c4-7546-42a6-91ea-8f441996771c] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:20.803711 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d12bbb5e-0b5e-41de-a907-f3faeb943d66 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:20.804206 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d12bbb5e-0b5e-41de-a907-f3faeb943d66 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:20.804647 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d12bbb5e-0b5e-41de-a907-f3faeb943d66 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:20.805358 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d12bbb5e-0b5e-41de-a907-f3faeb943d66 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:20.805819 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d12bbb5e-0b5e-41de-a907-f3faeb943d66 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:20.806738 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d12bbb5e-0b5e-41de-a907-f3faeb943d66 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:20.914992 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-9b355e37-07aa-4bba-ba0d-cdbe81359f22 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:20.924295 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-9b355e37-07aa-4bba-ba0d-cdbe81359f22 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d" status: 200 len: 1265 microversion: 2.1 time: 0.175191 Aug 31 12:38:20.924807 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 409/828] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:20 2022] GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:20.971704 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-d12bbb5e-0b5e-41de-a907-f3faeb943d66 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:20.980508 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-d12bbb5e-0b5e-41de-a907-f3faeb943d66 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c" status: 200 len: 1313 microversion: 2.1 time: 0.188262 Aug 31 12:38:20.981105 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 420/829] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:20 2022] GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:21.946171 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-ee9f53c2-da5b-4513-a59b-bf5ab481c165 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:21.946932 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-ee9f53c2-da5b-4513-a59b-bf5ab481c165 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:21.954273 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ee9f53c2-da5b-4513-a59b-bf5ab481c165 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:21.954786 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ee9f53c2-da5b-4513-a59b-bf5ab481c165 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:21.955263 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ee9f53c2-da5b-4513-a59b-bf5ab481c165 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:21.955971 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ee9f53c2-da5b-4513-a59b-bf5ab481c165 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:21.956424 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ee9f53c2-da5b-4513-a59b-bf5ab481c165 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:21.956841 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ee9f53c2-da5b-4513-a59b-bf5ab481c165 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:21.973095 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=100 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:22.001905 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-b5e712e5-f824-4595-b957-6a35b0902ef2 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:22.002542 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-b5e712e5-f824-4595-b957-6a35b0902ef2 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 9343f4c4-7546-42a6-91ea-8f441996771c] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:22.009443 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b5e712e5-f824-4595-b957-6a35b0902ef2 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:22.009997 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b5e712e5-f824-4595-b957-6a35b0902ef2 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:22.010443 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b5e712e5-f824-4595-b957-6a35b0902ef2 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:22.011194 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b5e712e5-f824-4595-b957-6a35b0902ef2 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:22.011652 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b5e712e5-f824-4595-b957-6a35b0902ef2 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:22.012076 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b5e712e5-f824-4595-b957-6a35b0902ef2 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:22.111602 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-ee9f53c2-da5b-4513-a59b-bf5ab481c165 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:22.121058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-ee9f53c2-da5b-4513-a59b-bf5ab481c165 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d" status: 200 len: 1265 microversion: 2.1 time: 0.178700 Aug 31 12:38:22.121943 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 410/830] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:21 2022] GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:22.154684 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-b5e712e5-f824-4595-b957-6a35b0902ef2 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:22.162741 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-b5e712e5-f824-4595-b957-6a35b0902ef2 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c" status: 200 len: 1313 microversion: 2.1 time: 0.164571 Aug 31 12:38:22.163308 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 421/831] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:21 2022] GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:23.141904 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-5a834143-6a14-479e-a3ae-0ca6273d9e3e tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:23.142508 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-5a834143-6a14-479e-a3ae-0ca6273d9e3e tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:23.150635 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5a834143-6a14-479e-a3ae-0ca6273d9e3e tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:23.150940 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5a834143-6a14-479e-a3ae-0ca6273d9e3e tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:23.151460 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5a834143-6a14-479e-a3ae-0ca6273d9e3e tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:23.152413 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5a834143-6a14-479e-a3ae-0ca6273d9e3e tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:23.153154 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5a834143-6a14-479e-a3ae-0ca6273d9e3e tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:23.153843 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5a834143-6a14-479e-a3ae-0ca6273d9e3e tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:23.185397 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-084a61c6-7cb8-450d-9e69-66a6a4b7f987 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:23.186668 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-084a61c6-7cb8-450d-9e69-66a6a4b7f987 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 9343f4c4-7546-42a6-91ea-8f441996771c] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:23.193728 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-084a61c6-7cb8-450d-9e69-66a6a4b7f987 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:23.194445 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-084a61c6-7cb8-450d-9e69-66a6a4b7f987 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:23.194911 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-084a61c6-7cb8-450d-9e69-66a6a4b7f987 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:23.195609 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-084a61c6-7cb8-450d-9e69-66a6a4b7f987 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:23.196238 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-084a61c6-7cb8-450d-9e69-66a6a4b7f987 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:23.196886 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-084a61c6-7cb8-450d-9e69-66a6a4b7f987 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:23.348406 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-5a834143-6a14-479e-a3ae-0ca6273d9e3e tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:23.357955 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-5a834143-6a14-479e-a3ae-0ca6273d9e3e tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d" status: 200 len: 1265 microversion: 2.1 time: 0.220103 Aug 31 12:38:23.358546 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 411/832] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:23 2022] GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:23.363142 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-5a2c3391-9aaa-4a90-a3ae-325693034995 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-727907792", "imageRef": "2aaf4ebd-395b-468e-bb6b-c663d01edea0", "flavorRef": "452", "networks": [{"uuid": "7d7c4a9e-151b-4400-823e-37aa38537914"}]}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:38:23.365031 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-084a61c6-7cb8-450d-9e69-66a6a4b7f987 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:23.374845 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-084a61c6-7cb8-450d-9e69-66a6a4b7f987 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c" status: 200 len: 1313 microversion: 2.1 time: 0.193305 Aug 31 12:38:23.375391 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 422/833] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:23 2022] GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:23.417761 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.network.neutron [None req-5a2c3391-9aaa-4a90-a3ae-325693034995 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] validate_networks() for [('7d7c4a9e-151b-4400-823e-37aa38537914', None, None, None, None, None)] {{(pid=120750) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:38:23.783428 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-5a2c3391-9aaa-4a90-a3ae-325693034995 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Flavor limits 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:38:23.783881 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-5a2c3391-9aaa-4a90-a3ae-325693034995 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Image limits 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:38:23.784376 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-5a2c3391-9aaa-4a90-a3ae-325693034995 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Flavor pref 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:38:23.784785 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-5a2c3391-9aaa-4a90-a3ae-325693034995 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Image pref 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:38:23.785196 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-5a2c3391-9aaa-4a90-a3ae-325693034995 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:38:23.795925 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5a2c3391-9aaa-4a90-a3ae-325693034995 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:23.796404 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5a2c3391-9aaa-4a90-a3ae-325693034995 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:23.796841 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5a2c3391-9aaa-4a90-a3ae-325693034995 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:23.797568 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5a2c3391-9aaa-4a90-a3ae-325693034995 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:23.798020 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5a2c3391-9aaa-4a90-a3ae-325693034995 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:23.798442 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5a2c3391-9aaa-4a90-a3ae-325693034995 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:23.816232 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-5a2c3391-9aaa-4a90-a3ae-325693034995 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Getting quotas for project 812b75d0fa3241d38b2727efe253ca20. Resources: {'cores', 'ram', 'instances'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:38:23.820279 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-5a2c3391-9aaa-4a90-a3ae-325693034995 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Getting quotas for user c4fb81a9221d435a8d9e38ab138cad4a and project 812b75d0fa3241d38b2727efe253ca20. Resources: {'cores', 'ram', 'instances'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:38:23.831823 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-5a2c3391-9aaa-4a90-a3ae-325693034995 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Going to run 1 instances... {{(pid=120750) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:38:23.834167 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-5a2c3391-9aaa-4a90-a3ae-325693034995 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: e4e61546-e514-46d6-922c-074767f50a78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aaf4ebd-395b-468e-bb6b-c663d01edea0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120750) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:38:23.881900 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-5a2c3391-9aaa-4a90-a3ae-325693034995 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522289 Aug 31 12:38:23.882716 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 412/834] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 31 12:38:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:38:23.895099 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-4bde07e2-140f-4e64-b7c1-48da10e3aaed tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:23.895834 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-4bde07e2-140f-4e64-b7c1-48da10e3aaed tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: e4e61546-e514-46d6-922c-074767f50a78] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:23.899290 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=2 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:23.901019 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=6 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:23.952897 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-4bde07e2-140f-4e64-b7c1-48da10e3aaed tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:23.960126 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-4bde07e2-140f-4e64-b7c1-48da10e3aaed tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78" status: 200 len: 1218 microversion: 2.1 time: 0.070035 Aug 31 12:38:23.960705 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 423/835] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:23 2022] GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:24.380003 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b34e6150-3301-40dd-b7bc-0005bc664a14 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:24.380629 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-b34e6150-3301-40dd-b7bc-0005bc664a14 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:24.387480 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b34e6150-3301-40dd-b7bc-0005bc664a14 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:24.387968 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b34e6150-3301-40dd-b7bc-0005bc664a14 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:24.388438 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b34e6150-3301-40dd-b7bc-0005bc664a14 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:24.389343 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b34e6150-3301-40dd-b7bc-0005bc664a14 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:24.389840 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b34e6150-3301-40dd-b7bc-0005bc664a14 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:24.390273 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b34e6150-3301-40dd-b7bc-0005bc664a14 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:24.397748 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-b8e5b46a-d47b-45f3-ba6a-400a0f42e214 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:24.398356 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-b8e5b46a-d47b-45f3-ba6a-400a0f42e214 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 9343f4c4-7546-42a6-91ea-8f441996771c] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:24.405446 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b8e5b46a-d47b-45f3-ba6a-400a0f42e214 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:24.405949 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b8e5b46a-d47b-45f3-ba6a-400a0f42e214 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:24.406383 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b8e5b46a-d47b-45f3-ba6a-400a0f42e214 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:24.407261 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b8e5b46a-d47b-45f3-ba6a-400a0f42e214 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:24.407889 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b8e5b46a-d47b-45f3-ba6a-400a0f42e214 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:24.408318 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b8e5b46a-d47b-45f3-ba6a-400a0f42e214 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:24.539483 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b34e6150-3301-40dd-b7bc-0005bc664a14 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:24.550067 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b34e6150-3301-40dd-b7bc-0005bc664a14 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d" status: 200 len: 1265 microversion: 2.1 time: 0.174285 Aug 31 12:38:24.550646 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 413/836] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:24 2022] GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:24.563878 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-b8e5b46a-d47b-45f3-ba6a-400a0f42e214 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:24.571953 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-b8e5b46a-d47b-45f3-ba6a-400a0f42e214 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c" status: 200 len: 1313 microversion: 2.1 time: 0.178213 Aug 31 12:38:24.572558 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 424/837] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:24 2022] GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:24.983497 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-2fe4c580-7a3c-4ac3-a565-df10aeaa7a64 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:24.984129 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-2fe4c580-7a3c-4ac3-a565-df10aeaa7a64 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: e4e61546-e514-46d6-922c-074767f50a78] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:24.992647 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2fe4c580-7a3c-4ac3-a565-df10aeaa7a64 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:24.993136 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2fe4c580-7a3c-4ac3-a565-df10aeaa7a64 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:24.993567 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2fe4c580-7a3c-4ac3-a565-df10aeaa7a64 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:24.994263 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2fe4c580-7a3c-4ac3-a565-df10aeaa7a64 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:24.994711 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2fe4c580-7a3c-4ac3-a565-df10aeaa7a64 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:24.995179 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2fe4c580-7a3c-4ac3-a565-df10aeaa7a64 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:25.303595 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-2fe4c580-7a3c-4ac3-a565-df10aeaa7a64 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:25.312062 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-2fe4c580-7a3c-4ac3-a565-df10aeaa7a64 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78" status: 200 len: 1278 microversion: 2.1 time: 0.333393 Aug 31 12:38:25.312662 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 414/838] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:24 2022] GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78 => generated 1278 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:25.573310 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-88243948-72c3-40fb-8c16-1d2ce6daf255 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:25.574009 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-88243948-72c3-40fb-8c16-1d2ce6daf255 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:25.580575 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-88243948-72c3-40fb-8c16-1d2ce6daf255 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:25.581068 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-88243948-72c3-40fb-8c16-1d2ce6daf255 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:25.581504 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-88243948-72c3-40fb-8c16-1d2ce6daf255 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:25.582200 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-88243948-72c3-40fb-8c16-1d2ce6daf255 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:25.582666 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-88243948-72c3-40fb-8c16-1d2ce6daf255 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:25.583126 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-88243948-72c3-40fb-8c16-1d2ce6daf255 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:25.592940 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-30287ebd-40cc-4137-a433-a524983cb834 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:25.593552 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-30287ebd-40cc-4137-a433-a524983cb834 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 9343f4c4-7546-42a6-91ea-8f441996771c] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:25.599874 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-30287ebd-40cc-4137-a433-a524983cb834 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:25.600564 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-30287ebd-40cc-4137-a433-a524983cb834 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:25.601149 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-30287ebd-40cc-4137-a433-a524983cb834 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:25.602034 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-30287ebd-40cc-4137-a433-a524983cb834 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:25.602637 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-30287ebd-40cc-4137-a433-a524983cb834 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:25.603697 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-30287ebd-40cc-4137-a433-a524983cb834 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:25.726326 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-88243948-72c3-40fb-8c16-1d2ce6daf255 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:25.735241 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-88243948-72c3-40fb-8c16-1d2ce6daf255 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d" status: 200 len: 1265 microversion: 2.1 time: 0.167318 Aug 31 12:38:25.735921 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 425/839] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:25 2022] GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:25.826785 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-30287ebd-40cc-4137-a433-a524983cb834 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:25.834389 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-30287ebd-40cc-4137-a433-a524983cb834 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c" status: 200 len: 1313 microversion: 2.1 time: 0.245229 Aug 31 12:38:25.834998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 415/840] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:25 2022] GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:26.333895 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-d442354f-13f2-462a-ae8a-cadb7d8cf4be tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:26.334517 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-d442354f-13f2-462a-ae8a-cadb7d8cf4be tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: e4e61546-e514-46d6-922c-074767f50a78] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:26.343043 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d442354f-13f2-462a-ae8a-cadb7d8cf4be tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:26.343532 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d442354f-13f2-462a-ae8a-cadb7d8cf4be tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:26.344161 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d442354f-13f2-462a-ae8a-cadb7d8cf4be tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:26.344878 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d442354f-13f2-462a-ae8a-cadb7d8cf4be tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:26.345328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d442354f-13f2-462a-ae8a-cadb7d8cf4be tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:26.345960 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d442354f-13f2-462a-ae8a-cadb7d8cf4be tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:26.488649 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-d442354f-13f2-462a-ae8a-cadb7d8cf4be tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:26.492494 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=100 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:26.498673 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-d442354f-13f2-462a-ae8a-cadb7d8cf4be tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78" status: 200 len: 1318 microversion: 2.1 time: 0.168700 Aug 31 12:38:26.499568 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 426/841] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:26 2022] GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:26.637912 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-8e0ebfbb-7031-41ba-b882-99fa83f6b319 req-922298e7-65ef-42b6-9088-9b55e379ea87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4e61546-e514-46d6-922c-074767f50a78", "tag": "aee0b970-c5c9-4b26-a8ca-a4f2e7f5339d"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:38:26.656045 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-8e0ebfbb-7031-41ba-b882-99fa83f6b319 req-922298e7-65ef-42b6-9088-9b55e379ea87 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:26.656644 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-8e0ebfbb-7031-41ba-b882-99fa83f6b319 req-922298e7-65ef-42b6-9088-9b55e379ea87 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:26.657177 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-8e0ebfbb-7031-41ba-b882-99fa83f6b319 req-922298e7-65ef-42b6-9088-9b55e379ea87 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:26.670006 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-8e0ebfbb-7031-41ba-b882-99fa83f6b319 req-922298e7-65ef-42b6-9088-9b55e379ea87 service nova] Creating event network-changed:aee0b970-c5c9-4b26-a8ca-a4f2e7f5339d for instance e4e61546-e514-46d6-922c-074767f50a78 on hv-cinder-85528 Aug 31 12:38:26.675561 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-8e0ebfbb-7031-41ba-b882-99fa83f6b319 req-922298e7-65ef-42b6-9088-9b55e379ea87 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045028 Aug 31 12:38:26.676298 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 416/842] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:38:26.757264 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-6e5b6d5e-2c77-4a07-ac2f-8809a6450816 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:26.758015 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-6e5b6d5e-2c77-4a07-ac2f-8809a6450816 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:26.767171 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6e5b6d5e-2c77-4a07-ac2f-8809a6450816 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:26.767800 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6e5b6d5e-2c77-4a07-ac2f-8809a6450816 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:26.768306 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6e5b6d5e-2c77-4a07-ac2f-8809a6450816 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:26.769081 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6e5b6d5e-2c77-4a07-ac2f-8809a6450816 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:26.769603 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6e5b6d5e-2c77-4a07-ac2f-8809a6450816 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:26.770094 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6e5b6d5e-2c77-4a07-ac2f-8809a6450816 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:26.858504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-07948215-2cb6-47fa-b931-0160b408c13d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:26.860290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-07948215-2cb6-47fa-b931-0160b408c13d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 9343f4c4-7546-42a6-91ea-8f441996771c] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:26.868234 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-07948215-2cb6-47fa-b931-0160b408c13d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:26.870411 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-07948215-2cb6-47fa-b931-0160b408c13d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:26.871133 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-07948215-2cb6-47fa-b931-0160b408c13d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:26.872763 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-07948215-2cb6-47fa-b931-0160b408c13d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:26.873625 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-07948215-2cb6-47fa-b931-0160b408c13d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:26.874677 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-07948215-2cb6-47fa-b931-0160b408c13d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:27.068095 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-6e5b6d5e-2c77-4a07-ac2f-8809a6450816 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:27.076143 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-6e5b6d5e-2c77-4a07-ac2f-8809a6450816 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d" status: 200 len: 1265 microversion: 2.1 time: 0.323251 Aug 31 12:38:27.077511 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 427/843] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:26 2022] GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d => generated 1265 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:27.119488 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-07948215-2cb6-47fa-b931-0160b408c13d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:27.130226 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-07948215-2cb6-47fa-b931-0160b408c13d tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c" status: 200 len: 1313 microversion: 2.1 time: 0.276550 Aug 31 12:38:27.131621 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 417/844] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:26 2022] GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:27.521061 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-04c1f873-1a50-46a9-8bbc-fffe445ff6b0 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:27.521899 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-04c1f873-1a50-46a9-8bbc-fffe445ff6b0 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: e4e61546-e514-46d6-922c-074767f50a78] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:27.530495 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-04c1f873-1a50-46a9-8bbc-fffe445ff6b0 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:27.531136 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-04c1f873-1a50-46a9-8bbc-fffe445ff6b0 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:27.531579 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-04c1f873-1a50-46a9-8bbc-fffe445ff6b0 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:27.532315 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-04c1f873-1a50-46a9-8bbc-fffe445ff6b0 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:27.532765 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-04c1f873-1a50-46a9-8bbc-fffe445ff6b0 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:27.533176 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-04c1f873-1a50-46a9-8bbc-fffe445ff6b0 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:27.689621 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-04c1f873-1a50-46a9-8bbc-fffe445ff6b0 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:27.698700 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-04c1f873-1a50-46a9-8bbc-fffe445ff6b0 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78" status: 200 len: 1318 microversion: 2.1 time: 0.181398 Aug 31 12:38:27.699353 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 428/845] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:27 2022] GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:28.099489 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-e87f275b-2e17-46ee-a454-0ceb117e6379 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:28.100131 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-e87f275b-2e17-46ee-a454-0ceb117e6379 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:28.107020 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e87f275b-2e17-46ee-a454-0ceb117e6379 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:28.107509 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e87f275b-2e17-46ee-a454-0ceb117e6379 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:28.107935 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e87f275b-2e17-46ee-a454-0ceb117e6379 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:28.108659 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e87f275b-2e17-46ee-a454-0ceb117e6379 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:28.109102 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e87f275b-2e17-46ee-a454-0ceb117e6379 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:28.109520 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e87f275b-2e17-46ee-a454-0ceb117e6379 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:28.151436 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-9a238f29-b43e-4d4c-adf3-b436eb3e80be tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:28.152045 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-9a238f29-b43e-4d4c-adf3-b436eb3e80be tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 9343f4c4-7546-42a6-91ea-8f441996771c] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:28.158461 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9a238f29-b43e-4d4c-adf3-b436eb3e80be tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:28.158988 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9a238f29-b43e-4d4c-adf3-b436eb3e80be tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:28.159422 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9a238f29-b43e-4d4c-adf3-b436eb3e80be tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:28.160109 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9a238f29-b43e-4d4c-adf3-b436eb3e80be tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:28.160561 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9a238f29-b43e-4d4c-adf3-b436eb3e80be tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:28.160977 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9a238f29-b43e-4d4c-adf3-b436eb3e80be tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:28.300713 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-9a238f29-b43e-4d4c-adf3-b436eb3e80be tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:28.309238 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-9a238f29-b43e-4d4c-adf3-b436eb3e80be tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c" status: 200 len: 1313 microversion: 2.1 time: 0.162069 Aug 31 12:38:28.309801 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 429/846] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:28 2022] GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:28.326010 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-e87f275b-2e17-46ee-a454-0ceb117e6379 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:28.333981 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-e87f275b-2e17-46ee-a454-0ceb117e6379 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d" status: 200 len: 1265 microversion: 2.1 time: 0.238400 Aug 31 12:38:28.334545 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 418/847] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:28 2022] GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:28.645674 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-d5889b1d-b3c0-4a2a-9b3d-91fe6ec9be4a req-8dfc4172-61f2-4dbe-bb9b-0fda0dadb495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a96c4a7-b50c-48dc-97be-91c9aae4fc3d", "name": "network-vif-plugged", "status": "completed", "tag": "a4a552df-b84c-41d7-b76b-420c62afae50"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:38:28.659619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-d5889b1d-b3c0-4a2a-9b3d-91fe6ec9be4a req-8dfc4172-61f2-4dbe-bb9b-0fda0dadb495 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:28.660476 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-d5889b1d-b3c0-4a2a-9b3d-91fe6ec9be4a req-8dfc4172-61f2-4dbe-bb9b-0fda0dadb495 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:28.660905 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-d5889b1d-b3c0-4a2a-9b3d-91fe6ec9be4a req-8dfc4172-61f2-4dbe-bb9b-0fda0dadb495 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:28.672705 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-d5889b1d-b3c0-4a2a-9b3d-91fe6ec9be4a req-8dfc4172-61f2-4dbe-bb9b-0fda0dadb495 service nova] Creating event network-vif-plugged:a4a552df-b84c-41d7-b76b-420c62afae50 for instance 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d on hv-cinder-85528 Aug 31 12:38:28.677781 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-d5889b1d-b3c0-4a2a-9b3d-91fe6ec9be4a req-8dfc4172-61f2-4dbe-bb9b-0fda0dadb495 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036440 Aug 31 12:38:28.678364 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 430/848] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:38:28.719820 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-429ef618-e0de-4c52-bd05-1ef586c5ee58 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:28.720917 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-429ef618-e0de-4c52-bd05-1ef586c5ee58 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: e4e61546-e514-46d6-922c-074767f50a78] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:28.726657 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-429ef618-e0de-4c52-bd05-1ef586c5ee58 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:28.727176 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-429ef618-e0de-4c52-bd05-1ef586c5ee58 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:28.727606 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-429ef618-e0de-4c52-bd05-1ef586c5ee58 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:28.728826 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-429ef618-e0de-4c52-bd05-1ef586c5ee58 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:28.729451 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-429ef618-e0de-4c52-bd05-1ef586c5ee58 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:28.729866 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-429ef618-e0de-4c52-bd05-1ef586c5ee58 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:28.895614 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-429ef618-e0de-4c52-bd05-1ef586c5ee58 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:28.914273 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-429ef618-e0de-4c52-bd05-1ef586c5ee58 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78" status: 200 len: 1318 microversion: 2.1 time: 0.197919 Aug 31 12:38:28.916418 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 419/849] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:28 2022] GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:29.331973 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-52a7934d-e47f-448f-848e-7d1c9beea5a8 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:29.332655 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-52a7934d-e47f-448f-848e-7d1c9beea5a8 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 9343f4c4-7546-42a6-91ea-8f441996771c] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:29.339511 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-52a7934d-e47f-448f-848e-7d1c9beea5a8 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:29.339999 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-52a7934d-e47f-448f-848e-7d1c9beea5a8 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:29.340428 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-52a7934d-e47f-448f-848e-7d1c9beea5a8 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:29.341123 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-52a7934d-e47f-448f-848e-7d1c9beea5a8 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:29.341571 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-52a7934d-e47f-448f-848e-7d1c9beea5a8 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:29.341991 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-52a7934d-e47f-448f-848e-7d1c9beea5a8 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:29.356954 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-eebf9b34-b405-4771-ab2b-f3069b0768d6 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:29.357669 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-eebf9b34-b405-4771-ab2b-f3069b0768d6 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:29.364327 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-eebf9b34-b405-4771-ab2b-f3069b0768d6 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:29.364806 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-eebf9b34-b405-4771-ab2b-f3069b0768d6 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:29.365235 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-eebf9b34-b405-4771-ab2b-f3069b0768d6 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:29.365926 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-eebf9b34-b405-4771-ab2b-f3069b0768d6 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:29.366656 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-eebf9b34-b405-4771-ab2b-f3069b0768d6 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:29.367095 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-eebf9b34-b405-4771-ab2b-f3069b0768d6 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:29.492962 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-52a7934d-e47f-448f-848e-7d1c9beea5a8 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:29.501936 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-52a7934d-e47f-448f-848e-7d1c9beea5a8 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c" status: 200 len: 1313 microversion: 2.1 time: 0.174597 Aug 31 12:38:29.502511 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 431/850] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:29 2022] GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:29.517951 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-eebf9b34-b405-4771-ab2b-f3069b0768d6 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:29.526704 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-eebf9b34-b405-4771-ab2b-f3069b0768d6 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d" status: 200 len: 1265 microversion: 2.1 time: 0.174492 Aug 31 12:38:29.527340 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 420/851] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:29 2022] GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:29.937224 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-a616a93f-aed6-4205-9c62-0627a6bb9530 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:29.937864 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-a616a93f-aed6-4205-9c62-0627a6bb9530 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: e4e61546-e514-46d6-922c-074767f50a78] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:29.944155 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a616a93f-aed6-4205-9c62-0627a6bb9530 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:29.944656 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a616a93f-aed6-4205-9c62-0627a6bb9530 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:29.945092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a616a93f-aed6-4205-9c62-0627a6bb9530 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:29.945796 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a616a93f-aed6-4205-9c62-0627a6bb9530 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:29.946256 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a616a93f-aed6-4205-9c62-0627a6bb9530 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:29.947324 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a616a93f-aed6-4205-9c62-0627a6bb9530 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:30.085743 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-a616a93f-aed6-4205-9c62-0627a6bb9530 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:30.095112 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-a616a93f-aed6-4205-9c62-0627a6bb9530 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78" status: 200 len: 1318 microversion: 2.1 time: 0.161541 Aug 31 12:38:30.095818 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 432/852] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:29 2022] GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:30.524068 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b0e38d8b-fe8e-459f-88d7-a236bc58a42e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:30.524762 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-b0e38d8b-fe8e-459f-88d7-a236bc58a42e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 9343f4c4-7546-42a6-91ea-8f441996771c] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:30.531491 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b0e38d8b-fe8e-459f-88d7-a236bc58a42e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:30.531979 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b0e38d8b-fe8e-459f-88d7-a236bc58a42e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:30.532407 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b0e38d8b-fe8e-459f-88d7-a236bc58a42e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:30.533095 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b0e38d8b-fe8e-459f-88d7-a236bc58a42e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:30.533545 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b0e38d8b-fe8e-459f-88d7-a236bc58a42e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:30.533965 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b0e38d8b-fe8e-459f-88d7-a236bc58a42e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:30.549609 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-d8d7d352-eaac-4aeb-827f-fed75f4fc436 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:30.550307 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-d8d7d352-eaac-4aeb-827f-fed75f4fc436 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:30.556962 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d8d7d352-eaac-4aeb-827f-fed75f4fc436 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:30.557539 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d8d7d352-eaac-4aeb-827f-fed75f4fc436 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:30.558036 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d8d7d352-eaac-4aeb-827f-fed75f4fc436 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:30.558808 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d8d7d352-eaac-4aeb-827f-fed75f4fc436 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:30.559368 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d8d7d352-eaac-4aeb-827f-fed75f4fc436 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:30.559854 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d8d7d352-eaac-4aeb-827f-fed75f4fc436 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:30.677523 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b0e38d8b-fe8e-459f-88d7-a236bc58a42e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:30.686874 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b0e38d8b-fe8e-459f-88d7-a236bc58a42e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c" status: 200 len: 1313 microversion: 2.1 time: 0.166740 Aug 31 12:38:30.687480 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 421/853] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:30 2022] GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:30.702155 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-054005e8-ea83-4802-ad8f-7991d3c2b10c req-c628f474-6d1d-4f7f-98f9-50fd1fb8d9f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9343f4c4-7546-42a6-91ea-8f441996771c", "name": "network-vif-plugged", "status": "completed", "tag": "3070f264-9903-4a87-b647-483d6174d428"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:38:30.704324 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-d8d7d352-eaac-4aeb-827f-fed75f4fc436 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:30.712553 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-d8d7d352-eaac-4aeb-827f-fed75f4fc436 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d" status: 200 len: 1452 microversion: 2.1 time: 0.166809 Aug 31 12:38:30.713181 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-054005e8-ea83-4802-ad8f-7991d3c2b10c req-c628f474-6d1d-4f7f-98f9-50fd1fb8d9f4 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:30.713684 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-054005e8-ea83-4802-ad8f-7991d3c2b10c req-c628f474-6d1d-4f7f-98f9-50fd1fb8d9f4 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:30.714319 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-054005e8-ea83-4802-ad8f-7991d3c2b10c req-c628f474-6d1d-4f7f-98f9-50fd1fb8d9f4 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:30.726211 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-054005e8-ea83-4802-ad8f-7991d3c2b10c req-c628f474-6d1d-4f7f-98f9-50fd1fb8d9f4 service nova] Creating event network-vif-plugged:3070f264-9903-4a87-b647-483d6174d428 for instance 9343f4c4-7546-42a6-91ea-8f441996771c on hv-cinder-85528 Aug 31 12:38:30.728867 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 433/854] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:30 2022] GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d => generated 1452 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:30.732209 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-054005e8-ea83-4802-ad8f-7991d3c2b10c req-c628f474-6d1d-4f7f-98f9-50fd1fb8d9f4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036024 Aug 31 12:38:30.732805 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 422/855] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:38:30.735231 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-e6c7a1c2-0662-4649-8794-1c8efad35b94 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:30.736044 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-e6c7a1c2-0662-4649-8794-1c8efad35b94 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:30.743402 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e6c7a1c2-0662-4649-8794-1c8efad35b94 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:30.744613 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e6c7a1c2-0662-4649-8794-1c8efad35b94 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:30.745233 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e6c7a1c2-0662-4649-8794-1c8efad35b94 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:30.746346 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e6c7a1c2-0662-4649-8794-1c8efad35b94 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:30.746725 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e6c7a1c2-0662-4649-8794-1c8efad35b94 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:30.747129 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e6c7a1c2-0662-4649-8794-1c8efad35b94 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:30.905730 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-e6c7a1c2-0662-4649-8794-1c8efad35b94 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:30.914534 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-e6c7a1c2-0662-4649-8794-1c8efad35b94 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d" status: 200 len: 1452 microversion: 2.1 time: 0.184389 Aug 31 12:38:30.915161 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 434/856] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:30 2022] GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d => generated 1452 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:31.118265 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-f407c0bf-c19b-4ce1-a5fb-4a7555575fb1 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:31.119908 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-f407c0bf-c19b-4ce1-a5fb-4a7555575fb1 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: e4e61546-e514-46d6-922c-074767f50a78] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:31.126526 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f407c0bf-c19b-4ce1-a5fb-4a7555575fb1 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:31.127559 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f407c0bf-c19b-4ce1-a5fb-4a7555575fb1 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:31.127703 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f407c0bf-c19b-4ce1-a5fb-4a7555575fb1 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:31.128478 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f407c0bf-c19b-4ce1-a5fb-4a7555575fb1 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:31.129008 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f407c0bf-c19b-4ce1-a5fb-4a7555575fb1 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:31.129506 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f407c0bf-c19b-4ce1-a5fb-4a7555575fb1 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:31.264098 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f407c0bf-c19b-4ce1-a5fb-4a7555575fb1 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:31.271816 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-f407c0bf-c19b-4ce1-a5fb-4a7555575fb1 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78" status: 200 len: 1318 microversion: 2.1 time: 0.158795 Aug 31 12:38:31.272381 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 423/857] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:31 2022] GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:31.708397 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-904bad28-3e84-461f-8dbd-6c0a62ffaa0b tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:31.708997 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-904bad28-3e84-461f-8dbd-6c0a62ffaa0b tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 9343f4c4-7546-42a6-91ea-8f441996771c] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:31.715557 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-904bad28-3e84-461f-8dbd-6c0a62ffaa0b tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:31.716049 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-904bad28-3e84-461f-8dbd-6c0a62ffaa0b tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:31.716499 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-904bad28-3e84-461f-8dbd-6c0a62ffaa0b tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:31.717190 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-904bad28-3e84-461f-8dbd-6c0a62ffaa0b tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:31.717644 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-904bad28-3e84-461f-8dbd-6c0a62ffaa0b tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:31.718065 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-904bad28-3e84-461f-8dbd-6c0a62ffaa0b tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:31.935445 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-904bad28-3e84-461f-8dbd-6c0a62ffaa0b tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:31.943690 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-904bad28-3e84-461f-8dbd-6c0a62ffaa0b tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c" status: 200 len: 1313 microversion: 2.1 time: 0.239141 Aug 31 12:38:31.944247 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 435/858] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:31 2022] GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:32.294345 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-d465f6f1-016f-475f-9044-119a99cb534d tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:32.294980 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-d465f6f1-016f-475f-9044-119a99cb534d tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: e4e61546-e514-46d6-922c-074767f50a78] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:32.301459 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d465f6f1-016f-475f-9044-119a99cb534d tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:32.301943 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d465f6f1-016f-475f-9044-119a99cb534d tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:32.302378 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d465f6f1-016f-475f-9044-119a99cb534d tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:32.303108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d465f6f1-016f-475f-9044-119a99cb534d tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:32.303561 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d465f6f1-016f-475f-9044-119a99cb534d tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:32.303987 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d465f6f1-016f-475f-9044-119a99cb534d tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:32.456928 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-d465f6f1-016f-475f-9044-119a99cb534d tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:32.465065 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-d465f6f1-016f-475f-9044-119a99cb534d tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78" status: 200 len: 1318 microversion: 2.1 time: 0.175777 Aug 31 12:38:32.465944 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 424/859] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:32 2022] GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:32.758702 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-ea237725-77c6-486c-a607-b6e019c9ab68 req-47702483-12ce-4969-b0a5-28f59fdbb143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4e61546-e514-46d6-922c-074767f50a78", "name": "network-vif-plugged", "status": "completed", "tag": "aee0b970-c5c9-4b26-a8ca-a4f2e7f5339d"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:38:32.769235 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-ea237725-77c6-486c-a607-b6e019c9ab68 req-47702483-12ce-4969-b0a5-28f59fdbb143 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:32.769715 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-ea237725-77c6-486c-a607-b6e019c9ab68 req-47702483-12ce-4969-b0a5-28f59fdbb143 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:32.770237 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-ea237725-77c6-486c-a607-b6e019c9ab68 req-47702483-12ce-4969-b0a5-28f59fdbb143 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:32.782323 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-ea237725-77c6-486c-a607-b6e019c9ab68 req-47702483-12ce-4969-b0a5-28f59fdbb143 service nova] Creating event network-vif-plugged:aee0b970-c5c9-4b26-a8ca-a4f2e7f5339d for instance e4e61546-e514-46d6-922c-074767f50a78 on hv-cinder-85528 Aug 31 12:38:32.787199 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-ea237725-77c6-486c-a607-b6e019c9ab68 req-47702483-12ce-4969-b0a5-28f59fdbb143 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032161 Aug 31 12:38:32.787787 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 436/860] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:38:32.971338 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-7ab7aae2-a8d2-4c6d-b2cb-4d257a568ed6 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:32.972088 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-7ab7aae2-a8d2-4c6d-b2cb-4d257a568ed6 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 9343f4c4-7546-42a6-91ea-8f441996771c] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:32.980622 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7ab7aae2-a8d2-4c6d-b2cb-4d257a568ed6 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:32.981471 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7ab7aae2-a8d2-4c6d-b2cb-4d257a568ed6 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:32.982176 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7ab7aae2-a8d2-4c6d-b2cb-4d257a568ed6 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:32.983179 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7ab7aae2-a8d2-4c6d-b2cb-4d257a568ed6 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:32.983835 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7ab7aae2-a8d2-4c6d-b2cb-4d257a568ed6 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:32.984481 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7ab7aae2-a8d2-4c6d-b2cb-4d257a568ed6 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:33.010441 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-c9a460f5-6de2-4005-b943-4338383db497 req-c577fe33-9cd8-47ea-b8ca-674b5458d657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a96c4a7-b50c-48dc-97be-91c9aae4fc3d", "tag": "a4a552df-b84c-41d7-b76b-420c62afae50"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:38:33.022952 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-c9a460f5-6de2-4005-b943-4338383db497 req-c577fe33-9cd8-47ea-b8ca-674b5458d657 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:33.023853 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-c9a460f5-6de2-4005-b943-4338383db497 req-c577fe33-9cd8-47ea-b8ca-674b5458d657 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:33.024534 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-c9a460f5-6de2-4005-b943-4338383db497 req-c577fe33-9cd8-47ea-b8ca-674b5458d657 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:33.039151 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-c9a460f5-6de2-4005-b943-4338383db497 req-c577fe33-9cd8-47ea-b8ca-674b5458d657 service nova] Creating event network-changed:a4a552df-b84c-41d7-b76b-420c62afae50 for instance 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d on hv-cinder-85528 Aug 31 12:38:33.044188 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-c9a460f5-6de2-4005-b943-4338383db497 req-c577fe33-9cd8-47ea-b8ca-674b5458d657 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039852 Aug 31 12:38:33.044921 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 437/861] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:38:33.138564 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-7ab7aae2-a8d2-4c6d-b2cb-4d257a568ed6 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:33.149393 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-7ab7aae2-a8d2-4c6d-b2cb-4d257a568ed6 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c" status: 200 len: 1497 microversion: 2.1 time: 0.186145 Aug 31 12:38:33.150582 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 425/862] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:32 2022] GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c => generated 1497 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:33.486967 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-5267086d-e98b-4325-91c5-b655c797480f tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:33.487656 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-5267086d-e98b-4325-91c5-b655c797480f tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: e4e61546-e514-46d6-922c-074767f50a78] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:33.495191 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5267086d-e98b-4325-91c5-b655c797480f tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:33.495684 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5267086d-e98b-4325-91c5-b655c797480f tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:33.496438 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5267086d-e98b-4325-91c5-b655c797480f tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:33.496824 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5267086d-e98b-4325-91c5-b655c797480f tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:33.497277 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5267086d-e98b-4325-91c5-b655c797480f tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:33.497697 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5267086d-e98b-4325-91c5-b655c797480f tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:33.647861 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-5267086d-e98b-4325-91c5-b655c797480f tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:33.657273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-5267086d-e98b-4325-91c5-b655c797480f tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78" status: 200 len: 1318 microversion: 2.1 time: 0.174506 Aug 31 12:38:33.667004 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 438/863] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:33 2022] GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:33.676878 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-c89964e4-ae71-4870-a768-7feccfdb2811 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:33.677453 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-c89964e4-ae71-4870-a768-7feccfdb2811 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 9343f4c4-7546-42a6-91ea-8f441996771c] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:33.685321 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c89964e4-ae71-4870-a768-7feccfdb2811 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:33.685816 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c89964e4-ae71-4870-a768-7feccfdb2811 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:33.686253 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c89964e4-ae71-4870-a768-7feccfdb2811 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:33.686974 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c89964e4-ae71-4870-a768-7feccfdb2811 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:33.687433 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c89964e4-ae71-4870-a768-7feccfdb2811 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:33.687854 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c89964e4-ae71-4870-a768-7feccfdb2811 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:33.716006 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-c89964e4-ae71-4870-a768-7feccfdb2811 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 9343f4c4-7546-42a6-91ea-8f441996771c] Going to try to terminate instance {{(pid=120750) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:38:33.898257 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell0:SELECT=2 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:33.899524 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell0:SELECT=16 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:33.958687 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-c89964e4-ae71-4870-a768-7feccfdb2811 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c" status: 204 len: 0 microversion: 2.1 time: 0.285357 Aug 31 12:38:33.959857 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 426/864] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 31 12:38:33 2022] DELETE /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:38:33.968428 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-b5409527-6454-4085-815f-b3b61a24300e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:33.969030 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-b5409527-6454-4085-815f-b3b61a24300e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 9343f4c4-7546-42a6-91ea-8f441996771c] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:33.977237 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=2 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:33.988319 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b5409527-6454-4085-815f-b3b61a24300e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:33.988319 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b5409527-6454-4085-815f-b3b61a24300e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:33.988319 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b5409527-6454-4085-815f-b3b61a24300e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:33.990036 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b5409527-6454-4085-815f-b3b61a24300e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:33.990743 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b5409527-6454-4085-815f-b3b61a24300e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:33.991826 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b5409527-6454-4085-815f-b3b61a24300e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:34.153864 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-b5409527-6454-4085-815f-b3b61a24300e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:34.162112 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-b5409527-6454-4085-815f-b3b61a24300e tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c" status: 200 len: 1503 microversion: 2.1 time: 0.197473 Aug 31 12:38:34.162754 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 439/865] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:33 2022] GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c => generated 1503 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:34.679186 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-1d1650fc-4c04-4ed5-a93f-4cb0a1071264 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:34.679871 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-1d1650fc-4c04-4ed5-a93f-4cb0a1071264 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: e4e61546-e514-46d6-922c-074767f50a78] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:34.682262 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:34.687461 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1d1650fc-4c04-4ed5-a93f-4cb0a1071264 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:34.687936 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1d1650fc-4c04-4ed5-a93f-4cb0a1071264 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:34.688359 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1d1650fc-4c04-4ed5-a93f-4cb0a1071264 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:34.689035 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1d1650fc-4c04-4ed5-a93f-4cb0a1071264 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:34.689475 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1d1650fc-4c04-4ed5-a93f-4cb0a1071264 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:34.689885 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1d1650fc-4c04-4ed5-a93f-4cb0a1071264 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:34.705686 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:34.827133 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-1d1650fc-4c04-4ed5-a93f-4cb0a1071264 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:34.835003 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-1d1650fc-4c04-4ed5-a93f-4cb0a1071264 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78" status: 200 len: 1318 microversion: 2.1 time: 0.160042 Aug 31 12:38:34.835552 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 427/866] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:34 2022] GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:35.184426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-cb587ca9-921c-4689-83d6-957def4d2390 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:35.185034 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-cb587ca9-921c-4689-83d6-957def4d2390 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 9343f4c4-7546-42a6-91ea-8f441996771c] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:35.191451 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cb587ca9-921c-4689-83d6-957def4d2390 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:35.191932 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cb587ca9-921c-4689-83d6-957def4d2390 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:35.192363 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cb587ca9-921c-4689-83d6-957def4d2390 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:35.193048 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cb587ca9-921c-4689-83d6-957def4d2390 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:35.193504 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cb587ca9-921c-4689-83d6-957def4d2390 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:35.193924 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cb587ca9-921c-4689-83d6-957def4d2390 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:35.336475 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-cb587ca9-921c-4689-83d6-957def4d2390 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:35.345318 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-cb587ca9-921c-4689-83d6-957def4d2390 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c" status: 200 len: 1503 microversion: 2.1 time: 0.165331 Aug 31 12:38:35.345905 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 440/867] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:35 2022] GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:35.857820 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-2a1f85bf-3398-4d74-aa3a-f43cb31b1682 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:35.858424 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-2a1f85bf-3398-4d74-aa3a-f43cb31b1682 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: e4e61546-e514-46d6-922c-074767f50a78] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:35.864873 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2a1f85bf-3398-4d74-aa3a-f43cb31b1682 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:35.865355 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2a1f85bf-3398-4d74-aa3a-f43cb31b1682 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:35.865790 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2a1f85bf-3398-4d74-aa3a-f43cb31b1682 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:35.866828 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2a1f85bf-3398-4d74-aa3a-f43cb31b1682 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:35.867313 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2a1f85bf-3398-4d74-aa3a-f43cb31b1682 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:35.867736 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-2a1f85bf-3398-4d74-aa3a-f43cb31b1682 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:36.084165 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-2a1f85bf-3398-4d74-aa3a-f43cb31b1682 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:36.092829 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-2a1f85bf-3398-4d74-aa3a-f43cb31b1682 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78" status: 200 len: 1505 microversion: 2.1 time: 0.238763 Aug 31 12:38:36.093394 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 428/868] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:35 2022] GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78 => generated 1505 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:36.114221 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-6525d1a2-97c7-4658-9f68-a0b5cc21aaa2 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd6247fe-d0bd-48e2-a490-526d515cc765", "device": "/dev/sdb"}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:38:36.116894 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-6525d1a2-97c7-4658-9f68-a0b5cc21aaa2 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: e4e61546-e514-46d6-922c-074767f50a78] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:36.123425 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6525d1a2-97c7-4658-9f68-a0b5cc21aaa2 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:36.123923 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6525d1a2-97c7-4658-9f68-a0b5cc21aaa2 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:36.124358 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6525d1a2-97c7-4658-9f68-a0b5cc21aaa2 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:36.125058 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6525d1a2-97c7-4658-9f68-a0b5cc21aaa2 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:36.125517 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6525d1a2-97c7-4658-9f68-a0b5cc21aaa2 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:36.125939 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-6525d1a2-97c7-4658-9f68-a0b5cc21aaa2 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:36.367325 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-46e74e8c-6908-4951-ada7-da7515256653 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:36.368615 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-46e74e8c-6908-4951-ada7-da7515256653 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 9343f4c4-7546-42a6-91ea-8f441996771c] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:36.378894 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-46e74e8c-6908-4951-ada7-da7515256653 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:36.379633 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-46e74e8c-6908-4951-ada7-da7515256653 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:36.380255 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-46e74e8c-6908-4951-ada7-da7515256653 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:36.381172 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-46e74e8c-6908-4951-ada7-da7515256653 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:36.381622 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-46e74e8c-6908-4951-ada7-da7515256653 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:36.382199 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-46e74e8c-6908-4951-ada7-da7515256653 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:36.390456 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-6525d1a2-97c7-4658-9f68-a0b5cc21aaa2 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "POST /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279767 Aug 31 12:38:36.391402 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 441/869] 10.222.0.79 () {60 vars in 1323 bytes} [Wed Aug 31 12:38:36 2022] POST /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:38:36.475382 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-46e74e8c-6908-4951-ada7-da7515256653 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ca778b2f2f45c29cc99cbbe190d76a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c8e3638b084b768d8ba4b0202af99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:36.475596 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-a0c33a2a-3567-4da1-8ba3-ed37564d1c91 req-428f12a5-1e78-475e-aca2-06c94f4f7863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9343f4c4-7546-42a6-91ea-8f441996771c", "name": "network-vif-deleted", "tag": "3070f264-9903-4a87-b647-483d6174d428"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:38:36.487146 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-46e74e8c-6908-4951-ada7-da7515256653 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c" status: 200 len: 1461 microversion: 2.1 time: 0.124955 Aug 31 12:38:36.487840 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-a0c33a2a-3567-4da1-8ba3-ed37564d1c91 req-428f12a5-1e78-475e-aca2-06c94f4f7863 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:36.488560 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-a0c33a2a-3567-4da1-8ba3-ed37564d1c91 req-428f12a5-1e78-475e-aca2-06c94f4f7863 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:36.488826 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 429/870] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:36 2022] GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c => generated 1461 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:36.489554 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-a0c33a2a-3567-4da1-8ba3-ed37564d1c91 req-428f12a5-1e78-475e-aca2-06c94f4f7863 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:36.501586 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-a0c33a2a-3567-4da1-8ba3-ed37564d1c91 req-428f12a5-1e78-475e-aca2-06c94f4f7863 service nova] Creating event network-vif-deleted:3070f264-9903-4a87-b647-483d6174d428 for instance 9343f4c4-7546-42a6-91ea-8f441996771c on hv-cinder-85528 Aug 31 12:38:36.507175 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-a0c33a2a-3567-4da1-8ba3-ed37564d1c91 req-428f12a5-1e78-475e-aca2-06c94f4f7863 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036843 Aug 31 12:38:36.508154 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 442/871] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:38:37.513720 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-84a99ecb-9f11-40c7-9b72-0d704e7cafd5 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:37.514424 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-84a99ecb-9f11-40c7-9b72-0d704e7cafd5 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] [instance: 9343f4c4-7546-42a6-91ea-8f441996771c] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:37.521405 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-84a99ecb-9f11-40c7-9b72-0d704e7cafd5 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:37.521962 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-84a99ecb-9f11-40c7-9b72-0d704e7cafd5 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:37.522692 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-84a99ecb-9f11-40c7-9b72-0d704e7cafd5 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:37.523425 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-84a99ecb-9f11-40c7-9b72-0d704e7cafd5 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:37.523881 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-84a99ecb-9f11-40c7-9b72-0d704e7cafd5 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:37.524299 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-84a99ecb-9f11-40c7-9b72-0d704e7cafd5 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:37.538326 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-84a99ecb-9f11-40c7-9b72-0d704e7cafd5 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] HTTP exception thrown: Instance 9343f4c4-7546-42a6-91ea-8f441996771c could not be found. Aug 31 12:38:37.540004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-84a99ecb-9f11-40c7-9b72-0d704e7cafd5 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Request method failure captured: Aug 31 12:38:37.540004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c HTTP/1.1 Aug 31 12:38:37.540004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:38:37.540004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:38:37.540004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:38:37.540004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 0 Aug 31 12:38:37.540004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:38:37.540004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:38:37.540004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:38:37.540004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:38:37.540004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1YX4jpSs_XHpUZ57T3LhL9NU02d1e3uenSdFREQ039IJwwXo-WERwcYc8ohTbwhaENEu34gfgoSy5_AdMLCTvraK23ojowXhUFhMeHPwyMRba7u4LMe_DRd5dBAvTEpEJR6J4gvD6tKVjqsMcQ35MMqEfVw2-b2KAYHyMnyk14Sy-U Aug 31 12:38:37.540004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:38:37.540004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:38:37.540004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:38:37.540004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:38:37.540004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:38:37.540004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:38:37.540004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: c5c8e3638b084b768d8ba4b0202af99d Aug 31 12:38:37.540004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-VolumesActionsTest-658817297 Aug 31 12:38:37.540004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:38:37.540004 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:38:37.542513 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c5c8e3638b084b768d8ba4b0202af99d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c5c8e3638b084b768d8ba4b0202af99d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c5c8e3638b084b768d8ba4b0202af99d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c5c8e3638b084b768d8ba4b0202af99d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:38:37.542513 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-VolumesActionsTest-658817297 Aug 31 12:38:37.542513 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: c5c8e3638b084b768d8ba4b0202af99d Aug 31 12:38:37.542513 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-VolumesActionsTest-658817297 Aug 31 12:38:37.542513 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-VolumesActionsTest-658817297-project Aug 31 12:38:37.542513 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:38:37.542513 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:38:37.542513 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: b4ca778b2f2f45c29cc99cbbe190d76a Aug 31 12:38:37.542513 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-VolumesActionsTest-658817297-project Aug 31 12:38:37.542513 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:38:37.542513 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Instance 9343f4c4-7546-42a6-91ea-8f441996771c could not be found. Aug 31 12:38:37.542513 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'id': '9343f4c4-7546-42a6-91ea-8f441996771c'} Aug 31 12:38:37.543359 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:38:37.543359 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:38:37.543359 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:38:37.543359 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:38:37.543359 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:38:37.543359 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:38:37.543359 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:38:37.543359 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:38:37.543359 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:38:37.543359 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:38:37.543359 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9343f4c4-7546-42a6-91ea-8f441996771c could not be found. Aug 31 12:38:37.543359 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:38:37.543359 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:38:37.543359 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:38:37.543359 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:38:37.543359 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:38:37.543359 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:38:37.543359 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:38:37.543359 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:38:37.543359 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:38:37.544676 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:38:37.544676 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:38:37.544676 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:38:37.544676 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:38:37.544676 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:38:37.544676 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:38:37.544676 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:38:37.544676 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9343f4c4-7546-42a6-91ea-8f441996771c could not be found. Aug 31 12:38:37.544676 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:38:37.544676 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:38:37.544676 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:38:37.544676 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:38:37.544676 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:38:37.544676 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:38:37.544676 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:38:37.544676 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:38:37.544676 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9343f4c4-7546-42a6-91ea-8f441996771c could not be found. Aug 31 12:38:37.544676 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:38:37.546026 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-84a99ecb-9f11-40c7-9b72-0d704e7cafd5 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] Returning 404 to user: Instance 9343f4c4-7546-42a6-91ea-8f441996771c could not be found. {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:38:37.546026 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-84a99ecb-9f11-40c7-9b72-0d704e7cafd5 tempest-VolumesActionsTest-658817297 tempest-VolumesActionsTest-658817297-project] 10.222.0.79 "GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c" status: 404 len: 111 microversion: 2.1 time: 0.032388 Aug 31 12:38:37.546026 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 430/872] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:37 2022] GET /compute/v2.1/servers/9343f4c4-7546-42a6-91ea-8f441996771c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:38:56.203233 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-64708793-3654-4bc5-8e7c-ae8b0ac64100 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:56.204240 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-64708793-3654-4bc5-8e7c-ae8b0ac64100 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: e4e61546-e514-46d6-922c-074767f50a78] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:56.209935 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:56.211557 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:56.226379 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-64708793-3654-4bc5-8e7c-ae8b0ac64100 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:56.228445 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-64708793-3654-4bc5-8e7c-ae8b0ac64100 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:56.229427 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-64708793-3654-4bc5-8e7c-ae8b0ac64100 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:56.230634 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-64708793-3654-4bc5-8e7c-ae8b0ac64100 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:56.231584 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-64708793-3654-4bc5-8e7c-ae8b0ac64100 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:56.232413 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-64708793-3654-4bc5-8e7c-ae8b0ac64100 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:56.365611 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.objects.instance [None req-64708793-3654-4bc5-8e7c-ae8b0ac64100 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lazy-loading 'services' on Instance uuid e4e61546-e514-46d6-922c-074767f50a78 {{(pid=120749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:38:56.462975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-64708793-3654-4bc5-8e7c-ae8b0ac64100 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78/os-volume_attachments/fd6247fe-d0bd-48e2-a490-526d515cc765" status: 202 len: 0 microversion: 2.1 time: 0.266729 Aug 31 12:38:56.463621 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 443/873] 10.222.0.79 () {58 vars in 1416 bytes} [Wed Aug 31 12:38:56 2022] DELETE /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78/os-volume_attachments/fd6247fe-d0bd-48e2-a490-526d515cc765 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:38:57.612296 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-bf24997e-0918-4183-8366-fe348d9fa297 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:57.612969 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-bf24997e-0918-4183-8366-fe348d9fa297 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: e4e61546-e514-46d6-922c-074767f50a78] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:57.615694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_api:SELECT=7 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:57.616344 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=17 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:57.622358 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bf24997e-0918-4183-8366-fe348d9fa297 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:57.622876 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bf24997e-0918-4183-8366-fe348d9fa297 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:57.623320 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bf24997e-0918-4183-8366-fe348d9fa297 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:57.624016 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bf24997e-0918-4183-8366-fe348d9fa297 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:57.624477 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bf24997e-0918-4183-8366-fe348d9fa297 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:57.624889 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bf24997e-0918-4183-8366-fe348d9fa297 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:57.653226 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-bf24997e-0918-4183-8366-fe348d9fa297 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: e4e61546-e514-46d6-922c-074767f50a78] Going to try to terminate instance {{(pid=120750) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:38:57.733105 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-bf24997e-0918-4183-8366-fe348d9fa297 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78" status: 204 len: 0 microversion: 2.1 time: 0.123901 Aug 31 12:38:57.734161 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 431/874] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 31 12:38:57 2022] DELETE /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:38:57.746829 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-0416a520-f59c-48ef-8677-7f177b6e13cf tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:57.747629 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-0416a520-f59c-48ef-8677-7f177b6e13cf tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: e4e61546-e514-46d6-922c-074767f50a78] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:57.757081 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0416a520-f59c-48ef-8677-7f177b6e13cf tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:57.757574 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0416a520-f59c-48ef-8677-7f177b6e13cf tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:57.758008 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0416a520-f59c-48ef-8677-7f177b6e13cf tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:57.758876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0416a520-f59c-48ef-8677-7f177b6e13cf tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:57.759634 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0416a520-f59c-48ef-8677-7f177b6e13cf tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:57.760241 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0416a520-f59c-48ef-8677-7f177b6e13cf tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:57.907751 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-0416a520-f59c-48ef-8677-7f177b6e13cf tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:57.916853 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-0416a520-f59c-48ef-8677-7f177b6e13cf tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78" status: 200 len: 1511 microversion: 2.1 time: 0.177012 Aug 31 12:38:57.917423 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 444/875] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:57 2022] GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78 => generated 1511 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:58.939363 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-be80b618-96bc-497d-8301-43c9ad01b845 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:58.940059 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-be80b618-96bc-497d-8301-43c9ad01b845 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: e4e61546-e514-46d6-922c-074767f50a78] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:58.948509 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-be80b618-96bc-497d-8301-43c9ad01b845 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:58.948992 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-be80b618-96bc-497d-8301-43c9ad01b845 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:58.949424 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-be80b618-96bc-497d-8301-43c9ad01b845 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:58.950151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-be80b618-96bc-497d-8301-43c9ad01b845 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:58.950593 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-be80b618-96bc-497d-8301-43c9ad01b845 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:58.951039 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-be80b618-96bc-497d-8301-43c9ad01b845 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:59.087939 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-be80b618-96bc-497d-8301-43c9ad01b845 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:59.095924 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-be80b618-96bc-497d-8301-43c9ad01b845 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78" status: 200 len: 1511 microversion: 2.1 time: 0.160757 Aug 31 12:38:59.096514 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 432/876] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:58 2022] GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:00.119607 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-4f5fc06a-6dcf-4c6e-89fa-7950557bab1b tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:00.120311 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-4f5fc06a-6dcf-4c6e-89fa-7950557bab1b tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: e4e61546-e514-46d6-922c-074767f50a78] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:00.128578 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4f5fc06a-6dcf-4c6e-89fa-7950557bab1b tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:00.129262 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4f5fc06a-6dcf-4c6e-89fa-7950557bab1b tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:00.129921 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4f5fc06a-6dcf-4c6e-89fa-7950557bab1b tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:00.130635 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4f5fc06a-6dcf-4c6e-89fa-7950557bab1b tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:00.131232 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4f5fc06a-6dcf-4c6e-89fa-7950557bab1b tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:00.131681 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4f5fc06a-6dcf-4c6e-89fa-7950557bab1b tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:00.312350 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-4f5fc06a-6dcf-4c6e-89fa-7950557bab1b tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:00.321038 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-4f5fc06a-6dcf-4c6e-89fa-7950557bab1b tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78" status: 200 len: 1511 microversion: 2.1 time: 0.207119 Aug 31 12:39:00.323398 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 445/877] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:00 2022] GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78 => generated 1511 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:00.874228 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-7328c9e5-fe98-4f81-9f54-1d57311e3093 req-f53d7cb7-a817-4d6a-ba66-749c9ffbfee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4e61546-e514-46d6-922c-074767f50a78", "name": "network-vif-deleted", "tag": "aee0b970-c5c9-4b26-a8ca-a4f2e7f5339d"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:39:00.896502 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-7328c9e5-fe98-4f81-9f54-1d57311e3093 req-f53d7cb7-a817-4d6a-ba66-749c9ffbfee5 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:00.897484 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-7328c9e5-fe98-4f81-9f54-1d57311e3093 req-f53d7cb7-a817-4d6a-ba66-749c9ffbfee5 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:00.898106 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-7328c9e5-fe98-4f81-9f54-1d57311e3093 req-f53d7cb7-a817-4d6a-ba66-749c9ffbfee5 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:00.912450 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-7328c9e5-fe98-4f81-9f54-1d57311e3093 req-f53d7cb7-a817-4d6a-ba66-749c9ffbfee5 service nova] Creating event network-vif-deleted:aee0b970-c5c9-4b26-a8ca-a4f2e7f5339d for instance e4e61546-e514-46d6-922c-074767f50a78 on hv-cinder-85528 Aug 31 12:39:00.922018 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-7328c9e5-fe98-4f81-9f54-1d57311e3093 req-f53d7cb7-a817-4d6a-ba66-749c9ffbfee5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053273 Aug 31 12:39:00.926209 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 433/878] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:39:01.347157 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-dcde28dd-1cf9-4b6f-bf55-8d122ab56db5 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:01.349050 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-dcde28dd-1cf9-4b6f-bf55-8d122ab56db5 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: e4e61546-e514-46d6-922c-074767f50a78] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:01.357585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-dcde28dd-1cf9-4b6f-bf55-8d122ab56db5 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:01.358216 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-dcde28dd-1cf9-4b6f-bf55-8d122ab56db5 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:01.359091 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-dcde28dd-1cf9-4b6f-bf55-8d122ab56db5 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:01.359945 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-dcde28dd-1cf9-4b6f-bf55-8d122ab56db5 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:01.360560 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-dcde28dd-1cf9-4b6f-bf55-8d122ab56db5 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:01.361145 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-dcde28dd-1cf9-4b6f-bf55-8d122ab56db5 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:01.401658 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-dcde28dd-1cf9-4b6f-bf55-8d122ab56db5 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:01.402278 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-dcde28dd-1cf9-4b6f-bf55-8d122ab56db5 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:01.402882 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-dcde28dd-1cf9-4b6f-bf55-8d122ab56db5 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:01.403514 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.objects.instance [None req-dcde28dd-1cf9-4b6f-bf55-8d122ab56db5 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lazy-loading 'fault' on Instance uuid e4e61546-e514-46d6-922c-074767f50a78 {{(pid=120749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:39:01.492819 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-dcde28dd-1cf9-4b6f-bf55-8d122ab56db5 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4fb81a9221d435a8d9e38ab138cad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b75d0fa3241d38b2727efe253ca20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:01.502520 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-dcde28dd-1cf9-4b6f-bf55-8d122ab56db5 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78" status: 200 len: 1308 microversion: 2.1 time: 0.161031 Aug 31 12:39:01.503611 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 446/879] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:01 2022] GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78 => generated 1308 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:02.530945 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-702b3144-a306-4f62-b90a-1be8c77503a6 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:02.531701 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-702b3144-a306-4f62-b90a-1be8c77503a6 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] [instance: e4e61546-e514-46d6-922c-074767f50a78] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:02.538924 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-702b3144-a306-4f62-b90a-1be8c77503a6 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:02.538924 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-702b3144-a306-4f62-b90a-1be8c77503a6 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:02.539482 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-702b3144-a306-4f62-b90a-1be8c77503a6 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:02.540452 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-702b3144-a306-4f62-b90a-1be8c77503a6 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:02.540972 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-702b3144-a306-4f62-b90a-1be8c77503a6 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:02.541390 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-702b3144-a306-4f62-b90a-1be8c77503a6 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:02.556104 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-702b3144-a306-4f62-b90a-1be8c77503a6 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] HTTP exception thrown: Instance e4e61546-e514-46d6-922c-074767f50a78 could not be found. Aug 31 12:39:02.558108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-702b3144-a306-4f62-b90a-1be8c77503a6 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Request method failure captured: Aug 31 12:39:02.558108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78 HTTP/1.1 Aug 31 12:39:02.558108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:39:02.558108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:39:02.558108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:39:02.558108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 0 Aug 31 12:39:02.558108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:39:02.558108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:39:02.558108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:39:02.558108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:39:02.558108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1XxboPZzp65tORq6hJVVJ8JvLJkmkZfou7DPF9xedLUXtV6L3OOoAhiNig1BLzpjsTgi5vqXluMvrmov3HNRRs-1GMopOlE7Y2OSghOAkbHHkfIigRKM7lVEN60Uf7u_R4b7iIjl8qsiv-D9sNb7W3l1hW5dxJ4C8vqz-Q45XRyaOs Aug 31 12:39:02.558108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:39:02.558108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:39:02.558108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:39:02.558108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:39:02.558108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:39:02.558108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:39:02.558108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: 812b75d0fa3241d38b2727efe253ca20 Aug 31 12:39:02.558108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1946876077 Aug 31 12:39:02.558108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:39:02.558108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:39:02.559829 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/812b75d0fa3241d38b2727efe253ca20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_812b75d0fa3241d38b2727efe253ca20", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/812b75d0fa3241d38b2727efe253ca20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/812b75d0fa3241d38b2727efe253ca20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:39:02.559829 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-VolumesSnapshotTestJSON-1946876077 Aug 31 12:39:02.559829 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: 812b75d0fa3241d38b2727efe253ca20 Aug 31 12:39:02.559829 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1946876077 Aug 31 12:39:02.559829 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-VolumesSnapshotTestJSON-1946876077-project Aug 31 12:39:02.559829 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:39:02.559829 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:39:02.559829 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: c4fb81a9221d435a8d9e38ab138cad4a Aug 31 12:39:02.559829 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-VolumesSnapshotTestJSON-1946876077-project Aug 31 12:39:02.559829 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:39:02.559829 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Instance e4e61546-e514-46d6-922c-074767f50a78 could not be found. Aug 31 12:39:02.559829 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'id': 'e4e61546-e514-46d6-922c-074767f50a78'} Aug 31 12:39:02.560998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:39:02.560998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:39:02.560998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:39:02.560998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:39:02.560998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:39:02.560998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:39:02.560998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:39:02.560998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:39:02.560998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:39:02.560998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:39:02.560998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4e61546-e514-46d6-922c-074767f50a78 could not be found. Aug 31 12:39:02.560998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:39:02.560998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:39:02.560998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:39:02.560998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:39:02.560998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:39:02.560998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:39:02.560998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:39:02.560998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:39:02.560998 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:39:02.562643 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:39:02.562643 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:39:02.562643 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:39:02.562643 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:39:02.562643 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:39:02.562643 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:39:02.562643 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:39:02.562643 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4e61546-e514-46d6-922c-074767f50a78 could not be found. Aug 31 12:39:02.562643 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:39:02.562643 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:39:02.562643 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:39:02.562643 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:39:02.562643 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:39:02.562643 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:39:02.562643 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:39:02.562643 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:39:02.562643 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4e61546-e514-46d6-922c-074767f50a78 could not be found. Aug 31 12:39:02.562643 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:39:02.563898 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-702b3144-a306-4f62-b90a-1be8c77503a6 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] Returning 404 to user: Instance e4e61546-e514-46d6-922c-074767f50a78 could not be found. {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:39:02.563898 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-702b3144-a306-4f62-b90a-1be8c77503a6 tempest-VolumesSnapshotTestJSON-1946876077 tempest-VolumesSnapshotTestJSON-1946876077-project] 10.222.0.79 "GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78" status: 404 len: 111 microversion: 2.1 time: 0.033789 Aug 31 12:39:02.563898 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 434/880] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:02 2022] GET /compute/v2.1/servers/e4e61546-e514-46d6-922c-074767f50a78 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:39:04.854904 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-baf6f7d0-3bf6-4b71-911f-8c788e34d317 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-465650875", "imageRef": "2aaf4ebd-395b-468e-bb6b-c663d01edea0", "flavorRef": "452"}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:39:04.909610 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.network.neutron [None req-baf6f7d0-3bf6-4b71-911f-8c788e34d317 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] validate_networks() for None {{(pid=120749) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:39:05.190157 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-baf6f7d0-3bf6-4b71-911f-8c788e34d317 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Flavor limits 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:39:05.190576 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-baf6f7d0-3bf6-4b71-911f-8c788e34d317 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Image limits 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:39:05.191084 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-baf6f7d0-3bf6-4b71-911f-8c788e34d317 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Flavor pref 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:39:05.191493 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-baf6f7d0-3bf6-4b71-911f-8c788e34d317 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Image pref 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:39:05.191908 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-baf6f7d0-3bf6-4b71-911f-8c788e34d317 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:39:05.201029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-baf6f7d0-3bf6-4b71-911f-8c788e34d317 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:05.201515 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-baf6f7d0-3bf6-4b71-911f-8c788e34d317 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:05.201976 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-baf6f7d0-3bf6-4b71-911f-8c788e34d317 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:05.202701 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-baf6f7d0-3bf6-4b71-911f-8c788e34d317 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:05.203177 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-baf6f7d0-3bf6-4b71-911f-8c788e34d317 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:05.203599 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-baf6f7d0-3bf6-4b71-911f-8c788e34d317 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:05.220698 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-baf6f7d0-3bf6-4b71-911f-8c788e34d317 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Getting quotas for project 7836bc76fed84b15b99afd31cb4a4b86. Resources: {'cores', 'ram', 'instances'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:39:05.224549 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-baf6f7d0-3bf6-4b71-911f-8c788e34d317 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Getting quotas for user 6af5196048374fe7b2d70fe972c31abb and project 7836bc76fed84b15b99afd31cb4a4b86. Resources: {'cores', 'ram', 'instances'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:39:05.235852 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-baf6f7d0-3bf6-4b71-911f-8c788e34d317 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Going to run 1 instances... {{(pid=120749) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:39:05.238393 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-baf6f7d0-3bf6-4b71-911f-8c788e34d317 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] [instance: de7f9934-3db9-4222-a33d-b8ba2f332e64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aaf4ebd-395b-468e-bb6b-c663d01edea0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:39:05.285084 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-baf6f7d0-3bf6-4b71-911f-8c788e34d317 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.434843 Aug 31 12:39:05.285755 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 447/881] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 31 12:39:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:39:05.297271 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b3fc681d-019f-457f-9fc3-003b97bc66e0 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:05.298014 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-b3fc681d-019f-457f-9fc3-003b97bc66e0 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] [instance: de7f9934-3db9-4222-a33d-b8ba2f332e64] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:05.364698 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b3fc681d-019f-457f-9fc3-003b97bc66e0 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5196048374fe7b2d70fe972c31abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836bc76fed84b15b99afd31cb4a4b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:05.374400 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b3fc681d-019f-457f-9fc3-003b97bc66e0 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] 10.222.0.79 "GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64" status: 200 len: 1214 microversion: 2.1 time: 0.080875 Aug 31 12:39:05.382486 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 435/882] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:05 2022] GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:05.612858 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-dd94f859-68d2-4370-8d02-40ca8d086256 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:05.613407 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-dd94f859-68d2-4370-8d02-40ca8d086256 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:05.622980 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-dd94f859-68d2-4370-8d02-40ca8d086256 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:05.623478 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-dd94f859-68d2-4370-8d02-40ca8d086256 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:05.623916 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-dd94f859-68d2-4370-8d02-40ca8d086256 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:05.624631 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-dd94f859-68d2-4370-8d02-40ca8d086256 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:05.625092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-dd94f859-68d2-4370-8d02-40ca8d086256 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:05.625530 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-dd94f859-68d2-4370-8d02-40ca8d086256 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:05.654438 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-dd94f859-68d2-4370-8d02-40ca8d086256 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98/ips" status: 200 len: 150 microversion: 2.1 time: 0.046744 Aug 31 12:39:05.655243 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 448/883] 10.222.0.79 () {58 vars in 1248 bytes} [Wed Aug 31 12:39:05 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:39:06.401358 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-5e4d485a-b816-45f2-92ef-0007a75c1df2 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:06.401958 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-5e4d485a-b816-45f2-92ef-0007a75c1df2 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] [instance: de7f9934-3db9-4222-a33d-b8ba2f332e64] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:06.409147 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5e4d485a-b816-45f2-92ef-0007a75c1df2 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:06.409562 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5e4d485a-b816-45f2-92ef-0007a75c1df2 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:06.410028 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5e4d485a-b816-45f2-92ef-0007a75c1df2 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:06.410712 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5e4d485a-b816-45f2-92ef-0007a75c1df2 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:06.411189 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5e4d485a-b816-45f2-92ef-0007a75c1df2 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:06.411609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5e4d485a-b816-45f2-92ef-0007a75c1df2 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:06.473545 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-5e4d485a-b816-45f2-92ef-0007a75c1df2 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5196048374fe7b2d70fe972c31abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836bc76fed84b15b99afd31cb4a4b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:06.481147 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-5e4d485a-b816-45f2-92ef-0007a75c1df2 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] 10.222.0.79 "GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64" status: 200 len: 1218 microversion: 2.1 time: 0.084265 Aug 31 12:39:06.481697 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 436/884] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:06 2022] GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:07.502466 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-5be87ac4-0774-4cee-a081-60d7ee6c608f tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:07.503193 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-5be87ac4-0774-4cee-a081-60d7ee6c608f tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] [instance: de7f9934-3db9-4222-a33d-b8ba2f332e64] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:07.510227 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5be87ac4-0774-4cee-a081-60d7ee6c608f tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:07.510884 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5be87ac4-0774-4cee-a081-60d7ee6c608f tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:07.511544 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5be87ac4-0774-4cee-a081-60d7ee6c608f tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:07.512496 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5be87ac4-0774-4cee-a081-60d7ee6c608f tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:07.512968 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5be87ac4-0774-4cee-a081-60d7ee6c608f tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:07.513400 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5be87ac4-0774-4cee-a081-60d7ee6c608f tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:07.576445 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-5be87ac4-0774-4cee-a081-60d7ee6c608f tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5196048374fe7b2d70fe972c31abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836bc76fed84b15b99afd31cb4a4b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:07.584571 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-5be87ac4-0774-4cee-a081-60d7ee6c608f tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] 10.222.0.79 "GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64" status: 200 len: 1266 microversion: 2.1 time: 0.085947 Aug 31 12:39:07.585128 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 449/885] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:07 2022] GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:08.066358 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-8769d63e-fda2-4e1e-ae56-b2c221b704c4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eafd7159-8df4-4ce8-a124-f84664b2fe83"}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:39:08.069047 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-8769d63e-fda2-4e1e-ae56-b2c221b704c4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:08.076523 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8769d63e-fda2-4e1e-ae56-b2c221b704c4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:08.077016 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8769d63e-fda2-4e1e-ae56-b2c221b704c4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:08.077453 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8769d63e-fda2-4e1e-ae56-b2c221b704c4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:08.078154 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8769d63e-fda2-4e1e-ae56-b2c221b704c4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:08.078603 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8769d63e-fda2-4e1e-ae56-b2c221b704c4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:08.079058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-8769d63e-fda2-4e1e-ae56-b2c221b704c4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:08.430140 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-8769d63e-fda2-4e1e-ae56-b2c221b704c4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "POST /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.367563 Aug 31 12:39:08.437629 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 437/886] 10.222.0.79 () {60 vars in 1323 bytes} [Wed Aug 31 12:39:08 2022] POST /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98/os-volume_attachments => generated 194 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:39:08.608397 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-1d54bd17-13a3-4cec-b3c4-7bd17aca94d6 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:08.609693 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-1d54bd17-13a3-4cec-b3c4-7bd17aca94d6 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] [instance: de7f9934-3db9-4222-a33d-b8ba2f332e64] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:08.617930 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1d54bd17-13a3-4cec-b3c4-7bd17aca94d6 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:08.618685 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1d54bd17-13a3-4cec-b3c4-7bd17aca94d6 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:08.619832 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1d54bd17-13a3-4cec-b3c4-7bd17aca94d6 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:08.620907 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1d54bd17-13a3-4cec-b3c4-7bd17aca94d6 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:08.621561 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1d54bd17-13a3-4cec-b3c4-7bd17aca94d6 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:08.621979 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-1d54bd17-13a3-4cec-b3c4-7bd17aca94d6 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:08.714540 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-1d54bd17-13a3-4cec-b3c4-7bd17aca94d6 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5196048374fe7b2d70fe972c31abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836bc76fed84b15b99afd31cb4a4b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:08.722845 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-1d54bd17-13a3-4cec-b3c4-7bd17aca94d6 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] 10.222.0.79 "GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64" status: 200 len: 1272 microversion: 2.1 time: 0.120389 Aug 31 12:39:08.723519 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 450/887] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:08 2022] GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64 => generated 1272 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:09.528960 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-ec6b2484-0bdd-421d-a774-e833d8fd6a12 req-40fd69db-b423-4685-8999-6ed94c34f499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de7f9934-3db9-4222-a33d-b8ba2f332e64", "tag": "a4ecaa55-e906-460d-b694-bc1db2598e47"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:39:09.539556 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-ec6b2484-0bdd-421d-a774-e833d8fd6a12 req-40fd69db-b423-4685-8999-6ed94c34f499 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:09.540120 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-ec6b2484-0bdd-421d-a774-e833d8fd6a12 req-40fd69db-b423-4685-8999-6ed94c34f499 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:09.540640 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-ec6b2484-0bdd-421d-a774-e833d8fd6a12 req-40fd69db-b423-4685-8999-6ed94c34f499 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:09.553400 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-ec6b2484-0bdd-421d-a774-e833d8fd6a12 req-40fd69db-b423-4685-8999-6ed94c34f499 service nova] Creating event network-changed:a4ecaa55-e906-460d-b694-bc1db2598e47 for instance de7f9934-3db9-4222-a33d-b8ba2f332e64 on hv-cinder-85528 Aug 31 12:39:09.558707 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-ec6b2484-0bdd-421d-a774-e833d8fd6a12 req-40fd69db-b423-4685-8999-6ed94c34f499 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035807 Aug 31 12:39:09.559866 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 438/888] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:39:09.744723 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-a8755c10-99e1-474e-a2ed-4492cdbcb1bf tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:09.746029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-a8755c10-99e1-474e-a2ed-4492cdbcb1bf tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] [instance: de7f9934-3db9-4222-a33d-b8ba2f332e64] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:09.754390 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a8755c10-99e1-474e-a2ed-4492cdbcb1bf tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:09.755002 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a8755c10-99e1-474e-a2ed-4492cdbcb1bf tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:09.755479 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a8755c10-99e1-474e-a2ed-4492cdbcb1bf tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:09.756376 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a8755c10-99e1-474e-a2ed-4492cdbcb1bf tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:09.756699 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a8755c10-99e1-474e-a2ed-4492cdbcb1bf tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:09.757104 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a8755c10-99e1-474e-a2ed-4492cdbcb1bf tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:09.913055 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-a8755c10-99e1-474e-a2ed-4492cdbcb1bf tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5196048374fe7b2d70fe972c31abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836bc76fed84b15b99afd31cb4a4b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:09.921828 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-a8755c10-99e1-474e-a2ed-4492cdbcb1bf tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] 10.222.0.79 "GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64" status: 200 len: 1314 microversion: 2.1 time: 0.181726 Aug 31 12:39:09.922886 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 451/889] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:09 2022] GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:10.943680 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-61c49ed2-455d-466c-b233-f568994f2b5b tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:10.944754 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-61c49ed2-455d-466c-b233-f568994f2b5b tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] [instance: de7f9934-3db9-4222-a33d-b8ba2f332e64] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:10.952283 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-61c49ed2-455d-466c-b233-f568994f2b5b tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:10.952772 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-61c49ed2-455d-466c-b233-f568994f2b5b tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:10.953207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-61c49ed2-455d-466c-b233-f568994f2b5b tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:10.953907 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-61c49ed2-455d-466c-b233-f568994f2b5b tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:10.954366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-61c49ed2-455d-466c-b233-f568994f2b5b tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:10.954788 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-61c49ed2-455d-466c-b233-f568994f2b5b tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:11.178578 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-61c49ed2-455d-466c-b233-f568994f2b5b tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5196048374fe7b2d70fe972c31abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836bc76fed84b15b99afd31cb4a4b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:11.187492 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-61c49ed2-455d-466c-b233-f568994f2b5b tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] 10.222.0.79 "GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64" status: 200 len: 1314 microversion: 2.1 time: 0.248375 Aug 31 12:39:11.188055 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 439/890] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:10 2022] GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:12.208282 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-b79ea6b5-0076-4c5c-997a-5eed2960f3ae tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:12.208895 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-b79ea6b5-0076-4c5c-997a-5eed2960f3ae tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] [instance: de7f9934-3db9-4222-a33d-b8ba2f332e64] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:12.216348 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b79ea6b5-0076-4c5c-997a-5eed2960f3ae tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:12.216841 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b79ea6b5-0076-4c5c-997a-5eed2960f3ae tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:12.217279 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b79ea6b5-0076-4c5c-997a-5eed2960f3ae tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:12.217982 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b79ea6b5-0076-4c5c-997a-5eed2960f3ae tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:12.218463 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b79ea6b5-0076-4c5c-997a-5eed2960f3ae tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:12.218909 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b79ea6b5-0076-4c5c-997a-5eed2960f3ae tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:12.350218 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-b79ea6b5-0076-4c5c-997a-5eed2960f3ae tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5196048374fe7b2d70fe972c31abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836bc76fed84b15b99afd31cb4a4b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:12.358584 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-b79ea6b5-0076-4c5c-997a-5eed2960f3ae tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] 10.222.0.79 "GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64" status: 200 len: 1314 microversion: 2.1 time: 0.154078 Aug 31 12:39:12.359191 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 452/891] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:12 2022] GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:13.380664 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-92e3fc30-b596-417f-a5cd-c772329f4c74 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:13.381277 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-92e3fc30-b596-417f-a5cd-c772329f4c74 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] [instance: de7f9934-3db9-4222-a33d-b8ba2f332e64] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:13.388747 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-92e3fc30-b596-417f-a5cd-c772329f4c74 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:13.389235 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-92e3fc30-b596-417f-a5cd-c772329f4c74 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:13.389666 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-92e3fc30-b596-417f-a5cd-c772329f4c74 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:13.390361 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-92e3fc30-b596-417f-a5cd-c772329f4c74 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:13.390813 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-92e3fc30-b596-417f-a5cd-c772329f4c74 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:13.391257 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-92e3fc30-b596-417f-a5cd-c772329f4c74 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:13.528523 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-92e3fc30-b596-417f-a5cd-c772329f4c74 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5196048374fe7b2d70fe972c31abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836bc76fed84b15b99afd31cb4a4b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:13.536634 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-92e3fc30-b596-417f-a5cd-c772329f4c74 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] 10.222.0.79 "GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64" status: 200 len: 1314 microversion: 2.1 time: 0.159755 Aug 31 12:39:13.537205 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 440/892] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:13 2022] GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:14.558686 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-bcb5386e-082b-4afb-a9b0-8359cd3342a8 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:14.559307 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-bcb5386e-082b-4afb-a9b0-8359cd3342a8 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] [instance: de7f9934-3db9-4222-a33d-b8ba2f332e64] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:14.565717 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bcb5386e-082b-4afb-a9b0-8359cd3342a8 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:14.566202 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bcb5386e-082b-4afb-a9b0-8359cd3342a8 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:14.566629 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bcb5386e-082b-4afb-a9b0-8359cd3342a8 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:14.567361 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bcb5386e-082b-4afb-a9b0-8359cd3342a8 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:14.567817 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bcb5386e-082b-4afb-a9b0-8359cd3342a8 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:14.568247 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bcb5386e-082b-4afb-a9b0-8359cd3342a8 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:14.716608 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-bcb5386e-082b-4afb-a9b0-8359cd3342a8 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5196048374fe7b2d70fe972c31abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836bc76fed84b15b99afd31cb4a4b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:14.724658 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-bcb5386e-082b-4afb-a9b0-8359cd3342a8 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] 10.222.0.79 "GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64" status: 200 len: 1314 microversion: 2.1 time: 0.170084 Aug 31 12:39:14.725247 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 453/893] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:14 2022] GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:15.752208 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-4456c4a1-eeaa-4d34-970f-c5904b41db53 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:15.752807 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-4456c4a1-eeaa-4d34-970f-c5904b41db53 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] [instance: de7f9934-3db9-4222-a33d-b8ba2f332e64] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:15.755373 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell0:SELECT=2 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:15.761248 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4456c4a1-eeaa-4d34-970f-c5904b41db53 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:15.761728 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4456c4a1-eeaa-4d34-970f-c5904b41db53 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:15.762151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4456c4a1-eeaa-4d34-970f-c5904b41db53 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:15.762835 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4456c4a1-eeaa-4d34-970f-c5904b41db53 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:15.763306 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4456c4a1-eeaa-4d34-970f-c5904b41db53 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:15.763720 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4456c4a1-eeaa-4d34-970f-c5904b41db53 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:15.909567 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-4456c4a1-eeaa-4d34-970f-c5904b41db53 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5196048374fe7b2d70fe972c31abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836bc76fed84b15b99afd31cb4a4b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:15.917924 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-4456c4a1-eeaa-4d34-970f-c5904b41db53 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] 10.222.0.79 "GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64" status: 200 len: 1314 microversion: 2.1 time: 0.169517 Aug 31 12:39:15.918599 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 441/894] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:15 2022] GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:16.938368 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-fe993db5-b383-4af6-906e-eaff269e5562 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:16.939158 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-fe993db5-b383-4af6-906e-eaff269e5562 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] [instance: de7f9934-3db9-4222-a33d-b8ba2f332e64] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:16.940992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=2 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:16.941655 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=6 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:16.950565 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fe993db5-b383-4af6-906e-eaff269e5562 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:16.951090 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fe993db5-b383-4af6-906e-eaff269e5562 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:16.951533 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fe993db5-b383-4af6-906e-eaff269e5562 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:16.952236 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fe993db5-b383-4af6-906e-eaff269e5562 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:16.952686 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fe993db5-b383-4af6-906e-eaff269e5562 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:16.953107 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fe993db5-b383-4af6-906e-eaff269e5562 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:17.126141 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-1594c617-5f68-4d5d-856a-35ac7e60e172 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eafd7159-8df4-4ce8-a124-f84664b2fe83"}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:39:17.128314 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-fe993db5-b383-4af6-906e-eaff269e5562 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5196048374fe7b2d70fe972c31abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836bc76fed84b15b99afd31cb4a4b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:17.129859 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-1594c617-5f68-4d5d-856a-35ac7e60e172 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:17.136690 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-fe993db5-b383-4af6-906e-eaff269e5562 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] 10.222.0.79 "GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64" status: 200 len: 1314 microversion: 2.1 time: 0.202084 Aug 31 12:39:17.137510 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 454/895] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:16 2022] GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:17.140174 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1594c617-5f68-4d5d-856a-35ac7e60e172 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:17.140821 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1594c617-5f68-4d5d-856a-35ac7e60e172 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:17.141363 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1594c617-5f68-4d5d-856a-35ac7e60e172 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:17.142344 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1594c617-5f68-4d5d-856a-35ac7e60e172 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:17.142980 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1594c617-5f68-4d5d-856a-35ac7e60e172 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:17.143650 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1594c617-5f68-4d5d-856a-35ac7e60e172 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:17.238479 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-1594c617-5f68-4d5d-856a-35ac7e60e172 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] HTTP exception thrown: Invalid volume: volume eafd7159-8df4-4ce8-a124-f84664b2fe83 is already attached to instances: 0be9b94a-a5f6-4443-862e-e33f7a794c98 Aug 31 12:39:17.240308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-1594c617-5f68-4d5d-856a-35ac7e60e172 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Request method failure captured: Aug 31 12:39:17.240308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: POST /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98/os-volume_attachments HTTP/1.1 Aug 31 12:39:17.240308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:39:17.240308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:39:17.240308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:39:17.240308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 74 Aug 31 12:39:17.240308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:39:17.240308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:39:17.240308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:39:17.240308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:39:17.240308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1WA4hDI1B8mwzFgw9UjF0bHYxh-W0PYTg_8OeWEX87GiaZzZhuOr6eQtJ_dbJdWxGbnvcJjpQHDWtPVijl1hs_KhQSiluyTrf3Gs1WSceTlpv-MeDVwBqGReHlFVzM62nzVejCXNhnFRVyOFKPna_2ISD5If38YADpegsr8a3mNzBI Aug 31 12:39:17.240308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:39:17.240308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:39:17.240308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:39:17.240308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:39:17.240308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:39:17.240308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:39:17.240308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: 8f6da846ab4f45a6ac4b2e34bf52abfc Aug 31 12:39:17.240308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:39:17.240308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:39:17.240308 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:39:17.242030 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8f6da846ab4f45a6ac4b2e34bf52abfc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:39:17.242030 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:39:17.242030 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: 8f6da846ab4f45a6ac4b2e34bf52abfc Aug 31 12:39:17.242030 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:39:17.242030 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-AttachVolumeNegativeTest-2001270308-project Aug 31 12:39:17.242030 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:39:17.242030 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:39:17.242030 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: d277532df42244c693b5e51e9fd0c459 Aug 31 12:39:17.242030 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-AttachVolumeNegativeTest-2001270308-project Aug 31 12:39:17.242030 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Aug 31 12:39:17.242030 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {"volumeAttachment": {"volumeId": "eafd7159-8df4-4ce8-a124-f84664b2fe83"}} Aug 31 12:39:17.242030 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:39:17.243366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Invalid volume: volume eafd7159-8df4-4ce8-a124-f84664b2fe83 is already attached to instances: 0be9b94a-a5f6-4443-862e-e33f7a794c98 Aug 31 12:39:17.243366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'server_id': '0be9b94a-a5f6-4443-862e-e33f7a794c98', 'body': {'volumeAttachment': {'volumeId': 'eafd7159-8df4-4ce8-a124-f84664b2fe83'}}} Aug 31 12:39:17.243366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:39:17.243366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:39:17.243366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 12:39:17.243366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 12:39:17.243366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 12:39:17.243366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 12:39:17.243366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 12:39:17.243366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 12:39:17.243366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 12:39:17.243366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 12:39:17.243366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 12:39:17.243366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 12:39:17.243366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume eafd7159-8df4-4ce8-a124-f84664b2fe83 is already attached to instances: 0be9b94a-a5f6-4443-862e-e33f7a794c98 Aug 31 12:39:17.243366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:39:17.243366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:39:17.243366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:39:17.243366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:39:17.245961 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:39:17.245961 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:39:17.245961 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:39:17.245961 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:39:17.245961 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:39:17.245961 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:39:17.245961 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 12:39:17.245961 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 12:39:17.245961 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 12:39:17.245961 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 12:39:17.245961 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 12:39:17.245961 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 12:39:17.245961 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 12:39:17.245961 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 12:39:17.245961 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume eafd7159-8df4-4ce8-a124-f84664b2fe83 is already attached to instances: 0be9b94a-a5f6-4443-862e-e33f7a794c98 Aug 31 12:39:17.245961 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:39:17.245961 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:39:17.245961 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:39:17.245961 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:39:17.245961 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:39:17.247734 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:39:17.247734 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:39:17.247734 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:39:17.247734 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume eafd7159-8df4-4ce8-a124-f84664b2fe83 is already attached to instances: 0be9b94a-a5f6-4443-862e-e33f7a794c98 Aug 31 12:39:17.247734 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:39:17.247734 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-1594c617-5f68-4d5d-856a-35ac7e60e172 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Returning 400 to user: Invalid volume: volume eafd7159-8df4-4ce8-a124-f84664b2fe83 is already attached to instances: 0be9b94a-a5f6-4443-862e-e33f7a794c98 {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:39:17.247734 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-1594c617-5f68-4d5d-856a-35ac7e60e172 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "POST /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.121887 Aug 31 12:39:17.247734 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 442/896] 10.222.0.79 () {60 vars in 1323 bytes} [Wed Aug 31 12:39:17 2022] POST /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98/os-volume_attachments => generated 174 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 12:39:17.314014 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-5346e5f5-9469-436b-bb32-54320b1d60b0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:17.314612 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-5346e5f5-9469-436b-bb32-54320b1d60b0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:17.320649 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5346e5f5-9469-436b-bb32-54320b1d60b0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:17.321121 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5346e5f5-9469-436b-bb32-54320b1d60b0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:17.321551 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5346e5f5-9469-436b-bb32-54320b1d60b0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:17.324273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5346e5f5-9469-436b-bb32-54320b1d60b0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:17.324746 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5346e5f5-9469-436b-bb32-54320b1d60b0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:17.325169 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5346e5f5-9469-436b-bb32-54320b1d60b0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:17.416775 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.objects.instance [None req-5346e5f5-9469-436b-bb32-54320b1d60b0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lazy-loading 'services' on Instance uuid 0be9b94a-a5f6-4443-862e-e33f7a794c98 {{(pid=120749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:39:17.493838 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-5346e5f5-9469-436b-bb32-54320b1d60b0 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98/os-volume_attachments/eafd7159-8df4-4ce8-a124-f84664b2fe83" status: 202 len: 0 microversion: 2.1 time: 0.183976 Aug 31 12:39:17.494529 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 455/897] 10.222.0.79 () {58 vars in 1416 bytes} [Wed Aug 31 12:39:17 2022] DELETE /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98/os-volume_attachments/eafd7159-8df4-4ce8-a124-f84664b2fe83 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:39:17.503135 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-db13a3e3-6e36-47f7-80da-87facf6a4fde tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:17.505267 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-db13a3e3-6e36-47f7-80da-87facf6a4fde tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:17.512186 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-db13a3e3-6e36-47f7-80da-87facf6a4fde tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:17.512680 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-db13a3e3-6e36-47f7-80da-87facf6a4fde tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:17.513111 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-db13a3e3-6e36-47f7-80da-87facf6a4fde tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:17.513821 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-db13a3e3-6e36-47f7-80da-87facf6a4fde tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:17.514369 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-db13a3e3-6e36-47f7-80da-87facf6a4fde tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:17.514753 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-db13a3e3-6e36-47f7-80da-87facf6a4fde tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:17.548856 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-db13a3e3-6e36-47f7-80da-87facf6a4fde tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049641 Aug 31 12:39:17.549436 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 443/898] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 31 12:39:17 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:39:17.876608 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-e8174790-03bd-49f8-b377-279495defcd3 req-9fdfcb5b-7c1a-48a2-b43e-73d40c19645d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7f9934-3db9-4222-a33d-b8ba2f332e64", "name": "network-vif-plugged", "status": "completed", "tag": "a4ecaa55-e906-460d-b694-bc1db2598e47"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:39:17.889606 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-e8174790-03bd-49f8-b377-279495defcd3 req-9fdfcb5b-7c1a-48a2-b43e-73d40c19645d service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:17.890495 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-e8174790-03bd-49f8-b377-279495defcd3 req-9fdfcb5b-7c1a-48a2-b43e-73d40c19645d service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:17.890954 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-e8174790-03bd-49f8-b377-279495defcd3 req-9fdfcb5b-7c1a-48a2-b43e-73d40c19645d service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:17.903529 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-e8174790-03bd-49f8-b377-279495defcd3 req-9fdfcb5b-7c1a-48a2-b43e-73d40c19645d service nova] Creating event network-vif-plugged:a4ecaa55-e906-460d-b694-bc1db2598e47 for instance de7f9934-3db9-4222-a33d-b8ba2f332e64 on hv-cinder-85528 Aug 31 12:39:17.909393 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-e8174790-03bd-49f8-b377-279495defcd3 req-9fdfcb5b-7c1a-48a2-b43e-73d40c19645d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036778 Aug 31 12:39:17.910210 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 456/899] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:39:18.157501 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-5143ba65-53cc-424d-8481-792977478262 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:18.158113 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-5143ba65-53cc-424d-8481-792977478262 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] [instance: de7f9934-3db9-4222-a33d-b8ba2f332e64] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:18.164781 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5143ba65-53cc-424d-8481-792977478262 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:18.165270 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5143ba65-53cc-424d-8481-792977478262 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:18.165703 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5143ba65-53cc-424d-8481-792977478262 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:18.167288 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5143ba65-53cc-424d-8481-792977478262 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:18.167811 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5143ba65-53cc-424d-8481-792977478262 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:18.168241 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5143ba65-53cc-424d-8481-792977478262 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:18.317031 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-5143ba65-53cc-424d-8481-792977478262 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5196048374fe7b2d70fe972c31abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836bc76fed84b15b99afd31cb4a4b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:18.328229 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-5143ba65-53cc-424d-8481-792977478262 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] 10.222.0.79 "GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64" status: 200 len: 1314 microversion: 2.1 time: 0.174449 Aug 31 12:39:18.328832 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 444/900] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:18 2022] GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:18.565327 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-0d0b2b3e-b053-4a69-aeb1-7dad29de2216 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:18.567697 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-0d0b2b3e-b053-4a69-aeb1-7dad29de2216 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:18.575289 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0d0b2b3e-b053-4a69-aeb1-7dad29de2216 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:18.575735 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0d0b2b3e-b053-4a69-aeb1-7dad29de2216 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:18.576183 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0d0b2b3e-b053-4a69-aeb1-7dad29de2216 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:18.576879 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0d0b2b3e-b053-4a69-aeb1-7dad29de2216 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:18.577327 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0d0b2b3e-b053-4a69-aeb1-7dad29de2216 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:18.577881 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0d0b2b3e-b053-4a69-aeb1-7dad29de2216 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:18.609657 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-0d0b2b3e-b053-4a69-aeb1-7dad29de2216 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048572 Aug 31 12:39:18.610223 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 457/901] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 31 12:39:18 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 12:39:18.691694 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-68dbdc36-d254-4c7a-a618-d1c0a5dcf385 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:18.692443 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-68dbdc36-d254-4c7a-a618-d1c0a5dcf385 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:18.699361 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-68dbdc36-d254-4c7a-a618-d1c0a5dcf385 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:18.699919 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-68dbdc36-d254-4c7a-a618-d1c0a5dcf385 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:18.700279 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-68dbdc36-d254-4c7a-a618-d1c0a5dcf385 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:18.701159 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-68dbdc36-d254-4c7a-a618-d1c0a5dcf385 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:18.701421 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-68dbdc36-d254-4c7a-a618-d1c0a5dcf385 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:18.701877 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-68dbdc36-d254-4c7a-a618-d1c0a5dcf385 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:18.727096 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-68dbdc36-d254-4c7a-a618-d1c0a5dcf385 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Going to try to terminate instance {{(pid=120750) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:39:18.783416 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:18.823957 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-68dbdc36-d254-4c7a-a618-d1c0a5dcf385 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 204 len: 0 microversion: 2.1 time: 0.135815 Aug 31 12:39:18.824524 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 445/902] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 31 12:39:18 2022] DELETE /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 12:39:18.832862 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-67db4e6b-70cd-41d6-875b-24ac673b53f4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:18.833730 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-67db4e6b-70cd-41d6-875b-24ac673b53f4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:18.841190 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-67db4e6b-70cd-41d6-875b-24ac673b53f4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:18.841731 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-67db4e6b-70cd-41d6-875b-24ac673b53f4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:18.842122 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-67db4e6b-70cd-41d6-875b-24ac673b53f4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:18.842817 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-67db4e6b-70cd-41d6-875b-24ac673b53f4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:18.843471 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-67db4e6b-70cd-41d6-875b-24ac673b53f4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:18.843899 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-67db4e6b-70cd-41d6-875b-24ac673b53f4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:18.995437 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-67db4e6b-70cd-41d6-875b-24ac673b53f4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:19.003732 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-67db4e6b-70cd-41d6-875b-24ac673b53f4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1679 microversion: 2.1 time: 0.174677 Aug 31 12:39:19.004310 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 458/903] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:18 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:19.351477 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-129a8b89-11ec-4dae-9582-c7e8fccc9017 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:19.352298 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-129a8b89-11ec-4dae-9582-c7e8fccc9017 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] [instance: de7f9934-3db9-4222-a33d-b8ba2f332e64] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:19.359194 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-129a8b89-11ec-4dae-9582-c7e8fccc9017 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:19.359674 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-129a8b89-11ec-4dae-9582-c7e8fccc9017 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:19.360102 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-129a8b89-11ec-4dae-9582-c7e8fccc9017 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:19.360803 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-129a8b89-11ec-4dae-9582-c7e8fccc9017 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:19.361247 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-129a8b89-11ec-4dae-9582-c7e8fccc9017 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:19.361663 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-129a8b89-11ec-4dae-9582-c7e8fccc9017 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:19.511407 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-129a8b89-11ec-4dae-9582-c7e8fccc9017 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5196048374fe7b2d70fe972c31abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836bc76fed84b15b99afd31cb4a4b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:19.519342 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-129a8b89-11ec-4dae-9582-c7e8fccc9017 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] 10.222.0.79 "GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64" status: 200 len: 1314 microversion: 2.1 time: 0.172047 Aug 31 12:39:19.520001 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 446/904] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:19 2022] GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:20.026753 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-f5b57a76-0879-49a6-a055-9008e81a20a1 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:20.027736 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-f5b57a76-0879-49a6-a055-9008e81a20a1 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:20.034363 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f5b57a76-0879-49a6-a055-9008e81a20a1 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:20.034950 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f5b57a76-0879-49a6-a055-9008e81a20a1 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:20.035421 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f5b57a76-0879-49a6-a055-9008e81a20a1 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:20.036082 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f5b57a76-0879-49a6-a055-9008e81a20a1 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:20.036549 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f5b57a76-0879-49a6-a055-9008e81a20a1 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:20.036967 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f5b57a76-0879-49a6-a055-9008e81a20a1 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:20.059856 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:20.184102 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-f5b57a76-0879-49a6-a055-9008e81a20a1 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:20.196563 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-f5b57a76-0879-49a6-a055-9008e81a20a1 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1679 microversion: 2.1 time: 0.174582 Aug 31 12:39:20.197398 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 459/905] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:20 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:20.540702 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-02e1d24e-9609-4aa9-97b9-ce6dd24fbe74 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:20.541972 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-02e1d24e-9609-4aa9-97b9-ce6dd24fbe74 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] [instance: de7f9934-3db9-4222-a33d-b8ba2f332e64] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:20.548476 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-02e1d24e-9609-4aa9-97b9-ce6dd24fbe74 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:20.548965 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-02e1d24e-9609-4aa9-97b9-ce6dd24fbe74 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:20.549401 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-02e1d24e-9609-4aa9-97b9-ce6dd24fbe74 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:20.550108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-02e1d24e-9609-4aa9-97b9-ce6dd24fbe74 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:20.550568 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-02e1d24e-9609-4aa9-97b9-ce6dd24fbe74 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:20.551028 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-02e1d24e-9609-4aa9-97b9-ce6dd24fbe74 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:20.703750 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-02e1d24e-9609-4aa9-97b9-ce6dd24fbe74 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5196048374fe7b2d70fe972c31abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836bc76fed84b15b99afd31cb4a4b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:20.711640 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-02e1d24e-9609-4aa9-97b9-ce6dd24fbe74 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] 10.222.0.79 "GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64" status: 200 len: 1464 microversion: 2.1 time: 0.174783 Aug 31 12:39:20.712257 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 447/906] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:20 2022] GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64 => generated 1464 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:20.757792 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-569dbff3-d322-4a6f-8c05-cedefdf1d56d tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:20.758280 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-569dbff3-d322-4a6f-8c05-cedefdf1d56d tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] [instance: de7f9934-3db9-4222-a33d-b8ba2f332e64] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:20.764974 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-569dbff3-d322-4a6f-8c05-cedefdf1d56d tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:20.765463 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-569dbff3-d322-4a6f-8c05-cedefdf1d56d tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:20.765897 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-569dbff3-d322-4a6f-8c05-cedefdf1d56d tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:20.766759 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-569dbff3-d322-4a6f-8c05-cedefdf1d56d tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:20.767121 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-569dbff3-d322-4a6f-8c05-cedefdf1d56d tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:20.767565 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-569dbff3-d322-4a6f-8c05-cedefdf1d56d tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:20.795766 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-569dbff3-d322-4a6f-8c05-cedefdf1d56d tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] [instance: de7f9934-3db9-4222-a33d-b8ba2f332e64] Going to try to terminate instance {{(pid=120749) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:39:20.885648 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-569dbff3-d322-4a6f-8c05-cedefdf1d56d tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] 10.222.0.79 "DELETE /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64" status: 204 len: 0 microversion: 2.1 time: 0.130680 Aug 31 12:39:20.886249 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 460/907] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 31 12:39:20 2022] DELETE /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:39:20.895284 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-5e431984-9d9e-4686-8c46-d8de5f3ac567 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:20.895811 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-5e431984-9d9e-4686-8c46-d8de5f3ac567 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] [instance: de7f9934-3db9-4222-a33d-b8ba2f332e64] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:20.902149 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5e431984-9d9e-4686-8c46-d8de5f3ac567 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:20.902637 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5e431984-9d9e-4686-8c46-d8de5f3ac567 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:20.903103 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5e431984-9d9e-4686-8c46-d8de5f3ac567 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:20.903884 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5e431984-9d9e-4686-8c46-d8de5f3ac567 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:20.904341 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5e431984-9d9e-4686-8c46-d8de5f3ac567 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:20.904766 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5e431984-9d9e-4686-8c46-d8de5f3ac567 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:21.054614 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-5e431984-9d9e-4686-8c46-d8de5f3ac567 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5196048374fe7b2d70fe972c31abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836bc76fed84b15b99afd31cb4a4b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:21.062861 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-5e431984-9d9e-4686-8c46-d8de5f3ac567 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] 10.222.0.79 "GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64" status: 200 len: 1470 microversion: 2.1 time: 0.171676 Aug 31 12:39:21.063500 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 448/908] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:20 2022] GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64 => generated 1470 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:21.220413 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-7fdc3860-854b-4e6a-93f6-34f6b2e9d47b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:21.221019 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-7fdc3860-854b-4e6a-93f6-34f6b2e9d47b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:21.227472 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7fdc3860-854b-4e6a-93f6-34f6b2e9d47b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:21.227961 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7fdc3860-854b-4e6a-93f6-34f6b2e9d47b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:21.229043 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7fdc3860-854b-4e6a-93f6-34f6b2e9d47b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:21.229910 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7fdc3860-854b-4e6a-93f6-34f6b2e9d47b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:21.230364 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7fdc3860-854b-4e6a-93f6-34f6b2e9d47b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:21.230789 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7fdc3860-854b-4e6a-93f6-34f6b2e9d47b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:21.359203 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-7fdc3860-854b-4e6a-93f6-34f6b2e9d47b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:21.366936 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-7fdc3860-854b-4e6a-93f6-34f6b2e9d47b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1679 microversion: 2.1 time: 0.151023 Aug 31 12:39:21.367763 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 461/909] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:21 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:22.084869 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-37e2f449-bac2-4b56-8f23-04e29be14f00 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:22.085470 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-37e2f449-bac2-4b56-8f23-04e29be14f00 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] [instance: de7f9934-3db9-4222-a33d-b8ba2f332e64] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:22.093010 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-37e2f449-bac2-4b56-8f23-04e29be14f00 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:22.093495 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-37e2f449-bac2-4b56-8f23-04e29be14f00 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:22.093926 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-37e2f449-bac2-4b56-8f23-04e29be14f00 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:22.094621 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-37e2f449-bac2-4b56-8f23-04e29be14f00 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:22.095109 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-37e2f449-bac2-4b56-8f23-04e29be14f00 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:22.095531 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-37e2f449-bac2-4b56-8f23-04e29be14f00 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:22.234665 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-37e2f449-bac2-4b56-8f23-04e29be14f00 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5196048374fe7b2d70fe972c31abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836bc76fed84b15b99afd31cb4a4b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:22.243134 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-37e2f449-bac2-4b56-8f23-04e29be14f00 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] 10.222.0.79 "GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64" status: 200 len: 1470 microversion: 2.1 time: 0.161777 Aug 31 12:39:22.243716 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 449/910] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:22 2022] GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64 => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:22.393564 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-251746eb-fdb5-4051-91f5-fc12e4d28a36 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:22.394295 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-251746eb-fdb5-4051-91f5-fc12e4d28a36 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:22.401623 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-251746eb-fdb5-4051-91f5-fc12e4d28a36 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:22.402115 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-251746eb-fdb5-4051-91f5-fc12e4d28a36 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:22.402549 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-251746eb-fdb5-4051-91f5-fc12e4d28a36 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:22.403289 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-251746eb-fdb5-4051-91f5-fc12e4d28a36 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:22.403745 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-251746eb-fdb5-4051-91f5-fc12e4d28a36 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:22.404172 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-251746eb-fdb5-4051-91f5-fc12e4d28a36 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:22.549833 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-251746eb-fdb5-4051-91f5-fc12e4d28a36 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:22.557904 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-251746eb-fdb5-4051-91f5-fc12e4d28a36 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1679 microversion: 2.1 time: 0.170632 Aug 31 12:39:22.558476 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 462/911] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:22 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:23.192343 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-d20b36ab-fcc7-4f70-8905-23ee68243090 req-422e32a7-cb35-4790-93d1-cf5e79f441c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7f9934-3db9-4222-a33d-b8ba2f332e64", "name": "network-vif-deleted", "tag": "a4ecaa55-e906-460d-b694-bc1db2598e47"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:39:23.209774 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-d20b36ab-fcc7-4f70-8905-23ee68243090 req-422e32a7-cb35-4790-93d1-cf5e79f441c9 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:23.210808 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-d20b36ab-fcc7-4f70-8905-23ee68243090 req-422e32a7-cb35-4790-93d1-cf5e79f441c9 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:23.211586 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-d20b36ab-fcc7-4f70-8905-23ee68243090 req-422e32a7-cb35-4790-93d1-cf5e79f441c9 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:23.230041 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-d20b36ab-fcc7-4f70-8905-23ee68243090 req-422e32a7-cb35-4790-93d1-cf5e79f441c9 service nova] Creating event network-vif-deleted:a4ecaa55-e906-460d-b694-bc1db2598e47 for instance de7f9934-3db9-4222-a33d-b8ba2f332e64 on hv-cinder-85528 Aug 31 12:39:23.237444 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-d20b36ab-fcc7-4f70-8905-23ee68243090 req-422e32a7-cb35-4790-93d1-cf5e79f441c9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048808 Aug 31 12:39:23.238424 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 450/912] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:39:23.265741 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-04eb3fa0-3e74-464d-bb2a-776c36ec3b92 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:23.266639 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-04eb3fa0-3e74-464d-bb2a-776c36ec3b92 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] [instance: de7f9934-3db9-4222-a33d-b8ba2f332e64] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:23.285922 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-04eb3fa0-3e74-464d-bb2a-776c36ec3b92 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:23.287653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-04eb3fa0-3e74-464d-bb2a-776c36ec3b92 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:23.289609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-c531398b-8743-49be-b842-31b1bc80b3c4 req-4907a4e2-0d09-4655-bb9f-ba007fdebb39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0be9b94a-a5f6-4443-862e-e33f7a794c98", "name": "network-vif-deleted", "tag": "18d85183-cc62-46fa-94cd-7d3b37300e7d"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:39:23.290898 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-04eb3fa0-3e74-464d-bb2a-776c36ec3b92 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:23.292891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-04eb3fa0-3e74-464d-bb2a-776c36ec3b92 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:23.293377 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-04eb3fa0-3e74-464d-bb2a-776c36ec3b92 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:23.293808 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-04eb3fa0-3e74-464d-bb2a-776c36ec3b92 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:23.310792 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-c531398b-8743-49be-b842-31b1bc80b3c4 req-4907a4e2-0d09-4655-bb9f-ba007fdebb39 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:23.311846 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-c531398b-8743-49be-b842-31b1bc80b3c4 req-4907a4e2-0d09-4655-bb9f-ba007fdebb39 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:23.312531 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-c531398b-8743-49be-b842-31b1bc80b3c4 req-4907a4e2-0d09-4655-bb9f-ba007fdebb39 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:23.338831 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-c531398b-8743-49be-b842-31b1bc80b3c4 req-4907a4e2-0d09-4655-bb9f-ba007fdebb39 service nova] Creating event network-vif-deleted:18d85183-cc62-46fa-94cd-7d3b37300e7d for instance 0be9b94a-a5f6-4443-862e-e33f7a794c98 on hv-cinder-85528 Aug 31 12:39:23.348286 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-c531398b-8743-49be-b842-31b1bc80b3c4 req-4907a4e2-0d09-4655-bb9f-ba007fdebb39 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061863 Aug 31 12:39:23.351088 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 451/913] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:39:23.401033 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-04eb3fa0-3e74-464d-bb2a-776c36ec3b92 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5196048374fe7b2d70fe972c31abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7836bc76fed84b15b99afd31cb4a4b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:23.418416 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-04eb3fa0-3e74-464d-bb2a-776c36ec3b92 tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] 10.222.0.79 "GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64" status: 200 len: 1299 microversion: 2.1 time: 0.156530 Aug 31 12:39:23.419289 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 463/914] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:23 2022] GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64 => generated 1299 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:23.580479 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-0ccd2a63-1ff2-4718-a98d-575628a6247f tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:23.581647 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-0ccd2a63-1ff2-4718-a98d-575628a6247f tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:23.589012 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0ccd2a63-1ff2-4718-a98d-575628a6247f tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:23.590027 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0ccd2a63-1ff2-4718-a98d-575628a6247f tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:23.590844 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0ccd2a63-1ff2-4718-a98d-575628a6247f tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:23.591658 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0ccd2a63-1ff2-4718-a98d-575628a6247f tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:23.592272 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0ccd2a63-1ff2-4718-a98d-575628a6247f tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:23.592861 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0ccd2a63-1ff2-4718-a98d-575628a6247f tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:23.629673 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0ccd2a63-1ff2-4718-a98d-575628a6247f tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:23.630159 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0ccd2a63-1ff2-4718-a98d-575628a6247f tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:23.630834 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0ccd2a63-1ff2-4718-a98d-575628a6247f tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:23.631290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.objects.instance [None req-0ccd2a63-1ff2-4718-a98d-575628a6247f tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lazy-loading 'fault' on Instance uuid 0be9b94a-a5f6-4443-862e-e33f7a794c98 {{(pid=120750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:39:23.678463 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-0ccd2a63-1ff2-4718-a98d-575628a6247f tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:23.688218 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-0ccd2a63-1ff2-4718-a98d-575628a6247f tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 200 len: 1329 microversion: 2.1 time: 0.112113 Aug 31 12:39:23.688801 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 452/915] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:23 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 1329 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:24.446035 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-cd211927-cf9b-4541-9566-6b45ea36a26f tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:24.447956 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-cd211927-cf9b-4541-9566-6b45ea36a26f tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] [instance: de7f9934-3db9-4222-a33d-b8ba2f332e64] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:24.455795 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cd211927-cf9b-4541-9566-6b45ea36a26f tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:24.456220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cd211927-cf9b-4541-9566-6b45ea36a26f tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:24.456869 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cd211927-cf9b-4541-9566-6b45ea36a26f tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:24.458002 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cd211927-cf9b-4541-9566-6b45ea36a26f tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:24.458666 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cd211927-cf9b-4541-9566-6b45ea36a26f tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:24.459128 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-cd211927-cf9b-4541-9566-6b45ea36a26f tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:24.480966 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.wsgi [None req-cd211927-cf9b-4541-9566-6b45ea36a26f tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] HTTP exception thrown: Instance de7f9934-3db9-4222-a33d-b8ba2f332e64 could not be found. Aug 31 12:39:24.482585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-cd211927-cf9b-4541-9566-6b45ea36a26f tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Request method failure captured: Aug 31 12:39:24.482585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: request: GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64 HTTP/1.1 Aug 31 12:39:24.482585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept: application/json Aug 31 12:39:24.482585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept-Encoding: identity Aug 31 12:39:24.482585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Connection: close Aug 31 12:39:24.482585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Length: 0 Aug 31 12:39:24.482585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Type: application/json Aug 31 12:39:24.482585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Host: 10.222.0.79 Aug 31 12:39:24.482585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Openstack-System-Scope: None Aug 31 12:39:24.482585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: User-Agent: python-urllib3/1.26.12 Aug 31 12:39:24.482585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Auth-Token: gAAAAABjD1Zn0VcOlsqp5GMvJ9NbJE01a45eXxn-FO1UieAdAKltyHB6n0VVtNlVJVkIhL1lRAzuw9BvxPqUWMxotc8tDSyRmwJo2H4SAs7_Wct7RT3PaLnN9z5nsCTZ2crBqQcQSkzhK0zD7Ckleg1LFNVuVPmqdj5V-g7aHmmFNvyu7o0z2II Aug 31 12:39:24.482585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Id: None Aug 31 12:39:24.482585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Name: None Aug 31 12:39:24.482585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Identity-Status: Confirmed Aug 31 12:39:24.482585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Is-Admin-Project: True Aug 31 12:39:24.482585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Id: default Aug 31 12:39:24.482585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Name: Default Aug 31 12:39:24.482585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Id: 7836bc76fed84b15b99afd31cb4a4b86 Aug 31 12:39:24.482585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Name: tempest-VolumesNegativeTest-701823382 Aug 31 12:39:24.482585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Role: reader,member Aug 31 12:39:24.482585 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Roles: reader,member Aug 31 12:39:24.484319 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7836bc76fed84b15b99afd31cb4a4b86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7836bc76fed84b15b99afd31cb4a4b86", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7836bc76fed84b15b99afd31cb4a4b86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7836bc76fed84b15b99afd31cb4a4b86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:39:24.484319 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant: tempest-VolumesNegativeTest-701823382 Aug 31 12:39:24.484319 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Id: 7836bc76fed84b15b99afd31cb4a4b86 Aug 31 12:39:24.484319 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Name: tempest-VolumesNegativeTest-701823382 Aug 31 12:39:24.484319 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User: tempest-VolumesNegativeTest-701823382-project Aug 31 12:39:24.484319 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Id: default Aug 31 12:39:24.484319 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Name: Default Aug 31 12:39:24.484319 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Id: 6af5196048374fe7b2d70fe972c31abb Aug 31 12:39:24.484319 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Name: tempest-VolumesNegativeTest-701823382-project Aug 31 12:39:24.484319 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: method: > Aug 31 12:39:24.484319 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: exception: Instance de7f9934-3db9-4222-a33d-b8ba2f332e64 could not be found. Aug 31 12:39:24.484319 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: action_args: {'id': 'de7f9934-3db9-4222-a33d-b8ba2f332e64'} Aug 31 12:39:24.485187 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:39:24.485187 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:39:24.485187 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:39:24.485187 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:39:24.485187 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:39:24.485187 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:39:24.485187 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:39:24.485187 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:39:24.485187 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:39:24.485187 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:39:24.485187 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de7f9934-3db9-4222-a33d-b8ba2f332e64 could not be found. Aug 31 12:39:24.485187 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:39:24.485187 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:39:24.485187 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:39:24.485187 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:39:24.485187 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:39:24.485187 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:39:24.485187 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:39:24.485187 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:39:24.485187 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:39:24.486548 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:39:24.486548 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:39:24.486548 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:39:24.486548 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:39:24.486548 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:39:24.486548 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:39:24.486548 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:39:24.486548 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de7f9934-3db9-4222-a33d-b8ba2f332e64 could not be found. Aug 31 12:39:24.486548 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:39:24.486548 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:39:24.486548 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:39:24.486548 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:39:24.486548 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:39:24.486548 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:39:24.486548 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:39:24.486548 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:39:24.486548 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de7f9934-3db9-4222-a33d-b8ba2f332e64 could not be found. Aug 31 12:39:24.486548 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:39:24.488102 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-cd211927-cf9b-4541-9566-6b45ea36a26f tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] Returning 404 to user: Instance de7f9934-3db9-4222-a33d-b8ba2f332e64 could not be found. {{(pid=120749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:39:24.489112 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-cd211927-cf9b-4541-9566-6b45ea36a26f tempest-VolumesNegativeTest-701823382 tempest-VolumesNegativeTest-701823382-project] 10.222.0.79 "GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64" status: 404 len: 111 microversion: 2.1 time: 0.052979 Aug 31 12:39:24.489701 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 464/916] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:24 2022] GET /compute/v2.1/servers/de7f9934-3db9-4222-a33d-b8ba2f332e64 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:39:24.709614 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-1c2047c2-879e-44c0-859f-3f3a290b8ad4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:24.710420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-1c2047c2-879e-44c0-859f-3f3a290b8ad4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:24.717607 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1c2047c2-879e-44c0-859f-3f3a290b8ad4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:24.718378 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1c2047c2-879e-44c0-859f-3f3a290b8ad4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:24.719052 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1c2047c2-879e-44c0-859f-3f3a290b8ad4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:24.720075 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1c2047c2-879e-44c0-859f-3f3a290b8ad4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:24.720530 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1c2047c2-879e-44c0-859f-3f3a290b8ad4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:24.721112 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1c2047c2-879e-44c0-859f-3f3a290b8ad4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:24.735924 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-1c2047c2-879e-44c0-859f-3f3a290b8ad4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] HTTP exception thrown: Instance 0be9b94a-a5f6-4443-862e-e33f7a794c98 could not be found. Aug 31 12:39:24.737609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-1c2047c2-879e-44c0-859f-3f3a290b8ad4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Request method failure captured: Aug 31 12:39:24.737609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 HTTP/1.1 Aug 31 12:39:24.737609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:39:24.737609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:39:24.737609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:39:24.737609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 0 Aug 31 12:39:24.737609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:39:24.737609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:39:24.737609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:39:24.737609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:39:24.737609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1WA4hDI1B8mwzFgw9UjF0bHYxh-W0PYTg_8OeWEX87GiaZzZhuOr6eQtJ_dbJdWxGbnvcJjpQHDWtPVijl1hs_KhQSiluyTrf3Gs1WSceTlpv-MeDVwBqGReHlFVzM62nzVejCXNhnFRVyOFKPna_2ISD5If38YADpegsr8a3mNzBI Aug 31 12:39:24.737609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:39:24.737609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:39:24.737609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:39:24.737609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:39:24.737609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:39:24.737609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:39:24.737609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: 8f6da846ab4f45a6ac4b2e34bf52abfc Aug 31 12:39:24.737609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:39:24.737609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:39:24.737609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:39:24.739458 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8f6da846ab4f45a6ac4b2e34bf52abfc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:39:24.739458 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:39:24.739458 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: 8f6da846ab4f45a6ac4b2e34bf52abfc Aug 31 12:39:24.739458 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:39:24.739458 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-AttachVolumeNegativeTest-2001270308-project Aug 31 12:39:24.739458 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:39:24.739458 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:39:24.739458 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: d277532df42244c693b5e51e9fd0c459 Aug 31 12:39:24.739458 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-AttachVolumeNegativeTest-2001270308-project Aug 31 12:39:24.739458 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:39:24.739458 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Instance 0be9b94a-a5f6-4443-862e-e33f7a794c98 could not be found. Aug 31 12:39:24.739458 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'id': '0be9b94a-a5f6-4443-862e-e33f7a794c98'} Aug 31 12:39:24.744256 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:39:24.744256 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:39:24.744256 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:39:24.744256 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:39:24.744256 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:39:24.744256 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:39:24.744256 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:39:24.744256 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:39:24.744256 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:39:24.744256 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:39:24.744256 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0be9b94a-a5f6-4443-862e-e33f7a794c98 could not be found. Aug 31 12:39:24.744256 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:39:24.744256 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:39:24.744256 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:39:24.744256 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:39:24.744256 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:39:24.744256 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:39:24.744256 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:39:24.744256 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:39:24.744256 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:39:24.746434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:39:24.746434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:39:24.746434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:39:24.746434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:39:24.746434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:39:24.746434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:39:24.746434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:39:24.746434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0be9b94a-a5f6-4443-862e-e33f7a794c98 could not be found. Aug 31 12:39:24.746434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:39:24.746434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:39:24.746434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:39:24.746434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:39:24.746434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:39:24.746434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:39:24.746434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:39:24.746434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:39:24.746434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0be9b94a-a5f6-4443-862e-e33f7a794c98 could not be found. Aug 31 12:39:24.746434 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:39:24.748644 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-1c2047c2-879e-44c0-859f-3f3a290b8ad4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Returning 404 to user: Instance 0be9b94a-a5f6-4443-862e-e33f7a794c98 could not be found. {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:39:24.748644 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-1c2047c2-879e-44c0-859f-3f3a290b8ad4 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 404 len: 111 microversion: 2.1 time: 0.033419 Aug 31 12:39:24.748644 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 453/917] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:24 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:39:24.749315 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-a1669c59-52cc-494d-93b8-5a28b4555ba2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '.version_select at 0x7f8d174bcf70>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:24.781144 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-a1669c59-52cc-494d-93b8-5a28b4555ba2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-86898781" status: 202 len: 0 microversion: 2.1 time: 0.036275 Aug 31 12:39:24.781734 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 465/918] 10.222.0.79 () {58 vars in 1215 bytes} [Wed Aug 31 12:39:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-86898781 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:39:25.453221 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-dd0e1cbc-007c-4dc9-8f97-04afa2a4e4bb tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Action: 'create', calling method: .version_select at 0x7f8d1708fc10>, body: {"keypair": {"name": "tempest-keypair-458177480", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNuNYB6oXMH09k7o2XjTnBB2bzTYGIDwCPEZWUHifc6yCOx87ZdA9tYH+igqGmCr7RyiDGcqvhVa7SBH+RbE6S7yZZ33Jtd/ZbmvW04UMlhSfLrTvoHHGXcEPJyAWXjGQ=="}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:39:25.474879 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-dd0e1cbc-007c-4dc9-8f97-04afa2a4e4bb tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Getting quotas for project 8f6da846ab4f45a6ac4b2e34bf52abfc. Resources: {'key_pairs'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:39:25.480500 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-dd0e1cbc-007c-4dc9-8f97-04afa2a4e4bb tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Getting quotas for user d277532df42244c693b5e51e9fd0c459 and project 8f6da846ab4f45a6ac4b2e34bf52abfc. Resources: {'key_pairs'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:39:25.514169 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-dd0e1cbc-007c-4dc9-8f97-04afa2a4e4bb tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.065180 Aug 31 12:39:25.515352 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 454/919] 10.222.0.79 () {60 vars in 1159 bytes} [Wed Aug 31 12:39:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:39:27.474918 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-4a37b620-79c6-4d5b-bc08-83014538493b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-705355261", "imageRef": "2aaf4ebd-395b-468e-bb6b-c663d01edea0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ccc93a47-ca46-4185-ba4c-b528eb9d4e58"}], "security_groups": [{"name": "tempest-securitygroup--841782547"}], "key_name": "tempest-keypair-458177480", "user_data": "}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:39:27.487601 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:27.649937 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.network.neutron [None req-4a37b620-79c6-4d5b-bc08-83014538493b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] validate_networks() for [('ccc93a47-ca46-4185-ba4c-b528eb9d4e58', None, None, None, None, None)] {{(pid=120749) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:39:28.178088 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-4a37b620-79c6-4d5b-bc08-83014538493b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Flavor limits 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:39:28.178650 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-4a37b620-79c6-4d5b-bc08-83014538493b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Image limits 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:39:28.179412 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-4a37b620-79c6-4d5b-bc08-83014538493b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Flavor pref 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:39:28.180200 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-4a37b620-79c6-4d5b-bc08-83014538493b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Image pref 0:0:0 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:39:28.181084 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.virt.hardware [None req-4a37b620-79c6-4d5b-bc08-83014538493b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:39:28.191881 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4a37b620-79c6-4d5b-bc08-83014538493b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:28.192527 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4a37b620-79c6-4d5b-bc08-83014538493b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:28.193005 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4a37b620-79c6-4d5b-bc08-83014538493b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:28.194008 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4a37b620-79c6-4d5b-bc08-83014538493b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:28.194835 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4a37b620-79c6-4d5b-bc08-83014538493b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:28.195444 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4a37b620-79c6-4d5b-bc08-83014538493b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:28.219577 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-4a37b620-79c6-4d5b-bc08-83014538493b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Getting quotas for project 8f6da846ab4f45a6ac4b2e34bf52abfc. Resources: {'cores', 'ram', 'instances'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:39:28.224797 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-4a37b620-79c6-4d5b-bc08-83014538493b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Getting quotas for user d277532df42244c693b5e51e9fd0c459 and project 8f6da846ab4f45a6ac4b2e34bf52abfc. Resources: {'cores', 'ram', 'instances'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:39:28.237517 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-4a37b620-79c6-4d5b-bc08-83014538493b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Going to run 1 instances... {{(pid=120749) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:39:28.239863 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-4a37b620-79c6-4d5b-bc08-83014538493b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aaf4ebd-395b-468e-bb6b-c663d01edea0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:39:28.297412 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-4a37b620-79c6-4d5b-bc08-83014538493b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.827045 Aug 31 12:39:28.298138 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 466/920] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 31 12:39:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:39:28.312181 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-ca2e37a1-a7d4-4cfe-9f27-c565459bcd4f tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:28.312861 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-ca2e37a1-a7d4-4cfe-9f27-c565459bcd4f tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:28.326894 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:28.444914 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-ca2e37a1-a7d4-4cfe-9f27-c565459bcd4f tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:28.453860 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-ca2e37a1-a7d4-4cfe-9f27-c565459bcd4f tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8" status: 200 len: 1240 microversion: 2.1 time: 0.147223 Aug 31 12:39:28.454449 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 455/921] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:28 2022] GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 => generated 1240 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:29.484138 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-77b1d88c-5b95-4e80-98bf-7d2d8d44c583 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:29.486959 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-77b1d88c-5b95-4e80-98bf-7d2d8d44c583 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:29.505490 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-77b1d88c-5b95-4e80-98bf-7d2d8d44c583 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:29.506620 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-77b1d88c-5b95-4e80-98bf-7d2d8d44c583 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:29.507305 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-77b1d88c-5b95-4e80-98bf-7d2d8d44c583 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:29.508366 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-77b1d88c-5b95-4e80-98bf-7d2d8d44c583 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:29.509030 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-77b1d88c-5b95-4e80-98bf-7d2d8d44c583 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:29.510322 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-77b1d88c-5b95-4e80-98bf-7d2d8d44c583 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:29.600276 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-77b1d88c-5b95-4e80-98bf-7d2d8d44c583 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:29.609477 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-77b1d88c-5b95-4e80-98bf-7d2d8d44c583 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8" status: 200 len: 1300 microversion: 2.1 time: 0.136001 Aug 31 12:39:29.610695 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 467/922] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:29 2022] GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 => generated 1300 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:30.641596 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-d64e3746-ed6d-4003-a414-e7e377db52b2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:30.642674 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-d64e3746-ed6d-4003-a414-e7e377db52b2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:30.658890 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d64e3746-ed6d-4003-a414-e7e377db52b2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:30.660038 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d64e3746-ed6d-4003-a414-e7e377db52b2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:30.661251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d64e3746-ed6d-4003-a414-e7e377db52b2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:30.668691 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d64e3746-ed6d-4003-a414-e7e377db52b2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:30.669975 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d64e3746-ed6d-4003-a414-e7e377db52b2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:30.674938 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d64e3746-ed6d-4003-a414-e7e377db52b2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:30.976852 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-d64e3746-ed6d-4003-a414-e7e377db52b2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:30.991538 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-d64e3746-ed6d-4003-a414-e7e377db52b2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8" status: 200 len: 1365 microversion: 2.1 time: 0.355642 Aug 31 12:39:30.993517 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 456/923] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:30 2022] GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 => generated 1365 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:31.393033 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-3a33a5c2-ab29-4c89-b876-34b502fb3e53 req-91c482df-a82a-4203-b64b-972fd03b5376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8", "tag": "ca849947-e6cc-41a0-8120-9cec92cdb0e2"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:39:31.410092 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-3a33a5c2-ab29-4c89-b876-34b502fb3e53 req-91c482df-a82a-4203-b64b-972fd03b5376 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:31.411357 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-3a33a5c2-ab29-4c89-b876-34b502fb3e53 req-91c482df-a82a-4203-b64b-972fd03b5376 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:31.412103 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-3a33a5c2-ab29-4c89-b876-34b502fb3e53 req-91c482df-a82a-4203-b64b-972fd03b5376 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:31.435332 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-3a33a5c2-ab29-4c89-b876-34b502fb3e53 req-91c482df-a82a-4203-b64b-972fd03b5376 service nova] Creating event network-changed:ca849947-e6cc-41a0-8120-9cec92cdb0e2 for instance 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 on hv-cinder-85528 Aug 31 12:39:31.443778 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-3a33a5c2-ab29-4c89-b876-34b502fb3e53 req-91c482df-a82a-4203-b64b-972fd03b5376 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055961 Aug 31 12:39:31.445326 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 468/924] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:39:32.023018 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-bc88dbd4-a908-42e8-a270-551af94743e8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:32.023778 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-bc88dbd4-a908-42e8-a270-551af94743e8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:32.031327 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bc88dbd4-a908-42e8-a270-551af94743e8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:32.031902 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bc88dbd4-a908-42e8-a270-551af94743e8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:32.032399 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bc88dbd4-a908-42e8-a270-551af94743e8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:32.033135 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bc88dbd4-a908-42e8-a270-551af94743e8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:32.033567 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bc88dbd4-a908-42e8-a270-551af94743e8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:32.033987 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bc88dbd4-a908-42e8-a270-551af94743e8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:32.415448 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-bc88dbd4-a908-42e8-a270-551af94743e8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:32.427951 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-bc88dbd4-a908-42e8-a270-551af94743e8 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8" status: 200 len: 1365 microversion: 2.1 time: 0.415713 Aug 31 12:39:32.428835 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 457/925] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:32 2022] GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 => generated 1365 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:33.450450 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-71276b0e-d1c9-4a1b-8cee-4e10ed47214d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:33.451892 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-71276b0e-d1c9-4a1b-8cee-4e10ed47214d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:33.459238 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-71276b0e-d1c9-4a1b-8cee-4e10ed47214d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:33.460583 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-71276b0e-d1c9-4a1b-8cee-4e10ed47214d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:33.461390 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-71276b0e-d1c9-4a1b-8cee-4e10ed47214d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:33.462649 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-71276b0e-d1c9-4a1b-8cee-4e10ed47214d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:33.463777 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-71276b0e-d1c9-4a1b-8cee-4e10ed47214d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:33.464564 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-71276b0e-d1c9-4a1b-8cee-4e10ed47214d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:33.774460 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-71276b0e-d1c9-4a1b-8cee-4e10ed47214d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:33.785377 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-71276b0e-d1c9-4a1b-8cee-4e10ed47214d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8" status: 200 len: 1365 microversion: 2.1 time: 0.338582 Aug 31 12:39:33.798897 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 469/926] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:33 2022] GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 => generated 1365 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:34.810933 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-0ce7ef69-5ce8-4326-ad62-41f9b002c11b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:34.813590 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-0ce7ef69-5ce8-4326-ad62-41f9b002c11b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:34.833568 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0ce7ef69-5ce8-4326-ad62-41f9b002c11b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:34.834477 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0ce7ef69-5ce8-4326-ad62-41f9b002c11b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:34.837432 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0ce7ef69-5ce8-4326-ad62-41f9b002c11b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:34.839486 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0ce7ef69-5ce8-4326-ad62-41f9b002c11b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:34.840438 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0ce7ef69-5ce8-4326-ad62-41f9b002c11b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:34.841392 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-0ce7ef69-5ce8-4326-ad62-41f9b002c11b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:35.040719 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-0ce7ef69-5ce8-4326-ad62-41f9b002c11b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:35.058616 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-0ce7ef69-5ce8-4326-ad62-41f9b002c11b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8" status: 200 len: 1365 microversion: 2.1 time: 0.254167 Aug 31 12:39:35.059508 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 458/927] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:34 2022] GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 => generated 1365 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:36.083604 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-e2075278-b8d3-49b1-ba5c-a60b40aebca7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:36.085229 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-e2075278-b8d3-49b1-ba5c-a60b40aebca7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:36.101093 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2075278-b8d3-49b1-ba5c-a60b40aebca7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:36.101807 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2075278-b8d3-49b1-ba5c-a60b40aebca7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:36.102247 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2075278-b8d3-49b1-ba5c-a60b40aebca7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:36.102993 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2075278-b8d3-49b1-ba5c-a60b40aebca7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:36.104335 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2075278-b8d3-49b1-ba5c-a60b40aebca7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:36.104971 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e2075278-b8d3-49b1-ba5c-a60b40aebca7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:36.286390 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-64341cc3-00f9-4cde-a8f8-f18af015ed01 req-6ef0c7ff-2e16-467f-9f23-40abe02edcfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8", "name": "network-vif-plugged", "status": "completed", "tag": "ca849947-e6cc-41a0-8120-9cec92cdb0e2"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:39:36.293725 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-e2075278-b8d3-49b1-ba5c-a60b40aebca7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:36.298401 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-64341cc3-00f9-4cde-a8f8-f18af015ed01 req-6ef0c7ff-2e16-467f-9f23-40abe02edcfb service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:36.299235 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-64341cc3-00f9-4cde-a8f8-f18af015ed01 req-6ef0c7ff-2e16-467f-9f23-40abe02edcfb service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:36.302114 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-64341cc3-00f9-4cde-a8f8-f18af015ed01 req-6ef0c7ff-2e16-467f-9f23-40abe02edcfb service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:36.312864 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-e2075278-b8d3-49b1-ba5c-a60b40aebca7 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8" status: 200 len: 1365 microversion: 2.1 time: 0.232281 Aug 31 12:39:36.313975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 470/928] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:36 2022] GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:36.315627 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-64341cc3-00f9-4cde-a8f8-f18af015ed01 req-6ef0c7ff-2e16-467f-9f23-40abe02edcfb service nova] Creating event network-vif-plugged:ca849947-e6cc-41a0-8120-9cec92cdb0e2 for instance 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 on hv-cinder-85528 Aug 31 12:39:36.321474 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-64341cc3-00f9-4cde-a8f8-f18af015ed01 req-6ef0c7ff-2e16-467f-9f23-40abe02edcfb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039477 Aug 31 12:39:36.322753 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 459/929] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:39:37.339342 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-37ca48ef-3921-4c5c-98b9-484ed5eb750d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:37.341498 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-37ca48ef-3921-4c5c-98b9-484ed5eb750d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:37.353086 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-37ca48ef-3921-4c5c-98b9-484ed5eb750d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:37.353759 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-37ca48ef-3921-4c5c-98b9-484ed5eb750d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:37.354279 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-37ca48ef-3921-4c5c-98b9-484ed5eb750d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:37.355040 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-37ca48ef-3921-4c5c-98b9-484ed5eb750d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:37.355767 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-37ca48ef-3921-4c5c-98b9-484ed5eb750d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:37.356600 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-37ca48ef-3921-4c5c-98b9-484ed5eb750d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:37.540934 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-37ca48ef-3921-4c5c-98b9-484ed5eb750d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:37.549549 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-37ca48ef-3921-4c5c-98b9-484ed5eb750d tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8" status: 200 len: 1365 microversion: 2.1 time: 0.216996 Aug 31 12:39:37.550254 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 471/930] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:37 2022] GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:38.571064 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell0:SELECT=6 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:38.591271 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-df49e8fa-a5f9-42f2-bbe3-77528fd61c8a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:38.592366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-df49e8fa-a5f9-42f2-bbe3-77528fd61c8a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:38.599825 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-df49e8fa-a5f9-42f2-bbe3-77528fd61c8a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:38.600725 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-df49e8fa-a5f9-42f2-bbe3-77528fd61c8a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:38.601267 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-df49e8fa-a5f9-42f2-bbe3-77528fd61c8a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:38.602253 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-df49e8fa-a5f9-42f2-bbe3-77528fd61c8a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:38.603053 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-df49e8fa-a5f9-42f2-bbe3-77528fd61c8a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:38.604346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-df49e8fa-a5f9-42f2-bbe3-77528fd61c8a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:38.794670 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-df49e8fa-a5f9-42f2-bbe3-77528fd61c8a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:38.817784 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-df49e8fa-a5f9-42f2-bbe3-77528fd61c8a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8" status: 200 len: 1556 microversion: 2.1 time: 0.247627 Aug 31 12:39:38.821303 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 460/931] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:38 2022] GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 => generated 1556 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:38.842659 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-8d07afd6-4b4e-4fce-b116-32da02a634ab tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:38.843714 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-8d07afd6-4b4e-4fce-b116-32da02a634ab tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:38.846946 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=2 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:38.848208 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=6 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:38.854471 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8d07afd6-4b4e-4fce-b116-32da02a634ab tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:38.854883 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8d07afd6-4b4e-4fce-b116-32da02a634ab tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:38.855531 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8d07afd6-4b4e-4fce-b116-32da02a634ab tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:38.856674 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8d07afd6-4b4e-4fce-b116-32da02a634ab tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:38.857361 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8d07afd6-4b4e-4fce-b116-32da02a634ab tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:38.857985 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8d07afd6-4b4e-4fce-b116-32da02a634ab tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:39.032731 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-8d07afd6-4b4e-4fce-b116-32da02a634ab tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.194650 Aug 31 12:39:39.034019 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 472/932] 10.222.0.79 () {58 vars in 1275 bytes} [Wed Aug 31 12:39:38 2022] GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8/os-interface => generated 285 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:39:40.860595 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-507c93bd-49ee-49d7-977b-c913bf40286d req-4280c15b-317f-484b-8afe-b5119fd24081 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8", "tag": "ca849947-e6cc-41a0-8120-9cec92cdb0e2"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:39:40.882675 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-507c93bd-49ee-49d7-977b-c913bf40286d req-4280c15b-317f-484b-8afe-b5119fd24081 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:40.883910 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-507c93bd-49ee-49d7-977b-c913bf40286d req-4280c15b-317f-484b-8afe-b5119fd24081 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:40.885412 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-507c93bd-49ee-49d7-977b-c913bf40286d req-4280c15b-317f-484b-8afe-b5119fd24081 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:40.910742 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-507c93bd-49ee-49d7-977b-c913bf40286d req-4280c15b-317f-484b-8afe-b5119fd24081 service nova] Creating event network-changed:ca849947-e6cc-41a0-8120-9cec92cdb0e2 for instance 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 on hv-cinder-85528 Aug 31 12:39:40.919759 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-507c93bd-49ee-49d7-977b-c913bf40286d req-4280c15b-317f-484b-8afe-b5119fd24081 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067416 Aug 31 12:39:40.921981 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 461/933] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:39:43.546786 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-ca963ea1-4af4-4378-ab22-ee14113869c7 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Action: 'create', calling method: .version_select at 0x7f8d16f1f0d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-173108296", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJI8Ci67N55dRzgoUP+7oByrA09SBGGmJG8Vo5KI9++xvCrUbIPO4P0HuRX9RjlEy0nFXboLoWQZgXEDCOjmBXqVGORkMRKhJundjSlE8qt9DnTXKE1q4CYBDcit5jnhw=="}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:39:43.566298 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-ca963ea1-4af4-4378-ab22-ee14113869c7 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Getting quotas for project 92cfd0189e5d478ca95f1b5a38809030. Resources: {'key_pairs'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:39:43.571846 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-ca963ea1-4af4-4378-ab22-ee14113869c7 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Getting quotas for user 4bc9e1e27ad3412e856dfda13a4f7e51 and project 92cfd0189e5d478ca95f1b5a38809030. Resources: {'key_pairs'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:39:43.602216 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-ca963ea1-4af4-4378-ab22-ee14113869c7 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.344984 Aug 31 12:39:43.603027 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 473/934] 10.222.0.79 () {60 vars in 1159 bytes} [Wed Aug 31 12:39:43 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:40:00.761492 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_api:SELECT=15 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:00.762248 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=66 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:00.767097 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-fbff4f52-be83-4ce7-aa18-0cd4956f440f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1505381326", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-173108296", "security_groups": [{"name": "tempest-secgroup-smoke-1020560105"}], "networks": [{"uuid": "12272e1b-1279-4100-b710-e51b4617f097"}], "block_device_mapping_v2": [{"uuid": "e80fbfd6-04d1-48b1-bb5f-5233b641c052", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:40:00.913867 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.network.neutron [None req-fbff4f52-be83-4ce7-aa18-0cd4956f440f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] validate_networks() for [('12272e1b-1279-4100-b710-e51b4617f097', None, None, None, None, None)] {{(pid=120750) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:40:01.358350 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-fbff4f52-be83-4ce7-aa18-0cd4956f440f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Flavor limits 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:40:01.358920 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-fbff4f52-be83-4ce7-aa18-0cd4956f440f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Image limits 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:40:01.359542 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-fbff4f52-be83-4ce7-aa18-0cd4956f440f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Flavor pref 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:40:01.360076 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-fbff4f52-be83-4ce7-aa18-0cd4956f440f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Image pref 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:40:01.360537 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-fbff4f52-be83-4ce7-aa18-0cd4956f440f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:40:01.371239 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fbff4f52-be83-4ce7-aa18-0cd4956f440f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:01.371714 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fbff4f52-be83-4ce7-aa18-0cd4956f440f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:01.372136 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fbff4f52-be83-4ce7-aa18-0cd4956f440f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:01.372849 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fbff4f52-be83-4ce7-aa18-0cd4956f440f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:01.373294 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fbff4f52-be83-4ce7-aa18-0cd4956f440f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:01.373746 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fbff4f52-be83-4ce7-aa18-0cd4956f440f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:01.392019 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-fbff4f52-be83-4ce7-aa18-0cd4956f440f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Getting quotas for project 92cfd0189e5d478ca95f1b5a38809030. Resources: {'cores', 'ram', 'instances'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:40:01.396254 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-fbff4f52-be83-4ce7-aa18-0cd4956f440f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Getting quotas for user 4bc9e1e27ad3412e856dfda13a4f7e51 and project 92cfd0189e5d478ca95f1b5a38809030. Resources: {'cores', 'ram', 'instances'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:40:01.470604 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-fbff4f52-be83-4ce7-aa18-0cd4956f440f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Going to run 1 instances... {{(pid=120750) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:40:01.472885 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-fbff4f52-be83-4ce7-aa18-0cd4956f440f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e80fbfd6-04d1-48b1-bb5f-5233b641c052',volume_size=None,volume_type=None)] {{(pid=120750) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:40:01.617134 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-fbff4f52-be83-4ce7-aa18-0cd4956f440f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.857793 Aug 31 12:40:01.617703 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 462/935] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 31 12:40:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 12:40:01.629592 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-cd71443d-34a1-4977-a567-92c2dbdcf1e9 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:01.630485 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-cd71443d-34a1-4977-a567-92c2dbdcf1e9 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:01.632420 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:01.633089 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=4 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:01.633740 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=4 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:01.700547 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-cd71443d-34a1-4977-a567-92c2dbdcf1e9 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:01.708398 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-cd71443d-34a1-4977-a567-92c2dbdcf1e9 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1088 microversion: 2.1 time: 0.082621 Aug 31 12:40:01.708985 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 474/936] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:01 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1088 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:02.732666 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-9006a983-7db1-4a98-972d-3c95c49ea347 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:02.733768 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-9006a983-7db1-4a98-972d-3c95c49ea347 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:02.740873 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9006a983-7db1-4a98-972d-3c95c49ea347 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:02.741380 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9006a983-7db1-4a98-972d-3c95c49ea347 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:02.741820 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9006a983-7db1-4a98-972d-3c95c49ea347 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:02.742548 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9006a983-7db1-4a98-972d-3c95c49ea347 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:02.743100 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9006a983-7db1-4a98-972d-3c95c49ea347 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:02.743773 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9006a983-7db1-4a98-972d-3c95c49ea347 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:02.849035 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-9006a983-7db1-4a98-972d-3c95c49ea347 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:02.859532 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-9006a983-7db1-4a98-972d-3c95c49ea347 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1194 microversion: 2.1 time: 0.131490 Aug 31 12:40:02.868685 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 463/937] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:02 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1194 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:03.883992 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-bb4d6c95-270d-43bf-8226-d31ef55a41d8 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:03.884773 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-bb4d6c95-270d-43bf-8226-d31ef55a41d8 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:03.891954 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bb4d6c95-270d-43bf-8226-d31ef55a41d8 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:03.892353 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bb4d6c95-270d-43bf-8226-d31ef55a41d8 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:03.892852 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bb4d6c95-270d-43bf-8226-d31ef55a41d8 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:03.893569 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bb4d6c95-270d-43bf-8226-d31ef55a41d8 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:03.894031 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bb4d6c95-270d-43bf-8226-d31ef55a41d8 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:03.894451 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bb4d6c95-270d-43bf-8226-d31ef55a41d8 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:04.067252 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-bb4d6c95-270d-43bf-8226-d31ef55a41d8 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:04.076477 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-bb4d6c95-270d-43bf-8226-d31ef55a41d8 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1260 microversion: 2.1 time: 0.196639 Aug 31 12:40:04.077116 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 475/938] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:03 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:04.426508 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-9cca8ba1-5674-43aa-ad3f-aa984db8175c req-18eef652-0f06-473d-8aab-a43e09bc9275 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68593769-d63a-425c-8988-3def34259a96", "tag": "c50ac0a0-bbf4-44a3-9255-25ee8afa88e4"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:40:04.439505 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-9cca8ba1-5674-43aa-ad3f-aa984db8175c req-18eef652-0f06-473d-8aab-a43e09bc9275 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:04.440135 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-9cca8ba1-5674-43aa-ad3f-aa984db8175c req-18eef652-0f06-473d-8aab-a43e09bc9275 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:04.440788 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-9cca8ba1-5674-43aa-ad3f-aa984db8175c req-18eef652-0f06-473d-8aab-a43e09bc9275 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:04.456489 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-9cca8ba1-5674-43aa-ad3f-aa984db8175c req-18eef652-0f06-473d-8aab-a43e09bc9275 service nova] Creating event network-changed:c50ac0a0-bbf4-44a3-9255-25ee8afa88e4 for instance 68593769-d63a-425c-8988-3def34259a96 on hv-cinder-85528 Aug 31 12:40:04.463019 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-9cca8ba1-5674-43aa-ad3f-aa984db8175c req-18eef652-0f06-473d-8aab-a43e09bc9275 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040019 Aug 31 12:40:04.463870 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 464/939] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:40:05.109921 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-70427a8e-6689-4d89-aedc-6280ee86a946 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:05.110533 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-70427a8e-6689-4d89-aedc-6280ee86a946 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:05.117480 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-70427a8e-6689-4d89-aedc-6280ee86a946 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:05.117975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-70427a8e-6689-4d89-aedc-6280ee86a946 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:05.118683 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-70427a8e-6689-4d89-aedc-6280ee86a946 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:05.120147 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-70427a8e-6689-4d89-aedc-6280ee86a946 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:05.120691 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-70427a8e-6689-4d89-aedc-6280ee86a946 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:05.121120 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-70427a8e-6689-4d89-aedc-6280ee86a946 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:05.277356 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-70427a8e-6689-4d89-aedc-6280ee86a946 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:05.285326 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-70427a8e-6689-4d89-aedc-6280ee86a946 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1260 microversion: 2.1 time: 0.179235 Aug 31 12:40:05.285903 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 476/940] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:05 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:06.307234 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-7e37f9f6-1e9f-45b3-b7d4-5d701ef3daeb tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:06.308411 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-7e37f9f6-1e9f-45b3-b7d4-5d701ef3daeb tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:06.315485 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7e37f9f6-1e9f-45b3-b7d4-5d701ef3daeb tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:06.315981 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7e37f9f6-1e9f-45b3-b7d4-5d701ef3daeb tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:06.316420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7e37f9f6-1e9f-45b3-b7d4-5d701ef3daeb tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:06.317135 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7e37f9f6-1e9f-45b3-b7d4-5d701ef3daeb tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:06.317589 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7e37f9f6-1e9f-45b3-b7d4-5d701ef3daeb tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:06.318014 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7e37f9f6-1e9f-45b3-b7d4-5d701ef3daeb tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:06.476153 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-7e37f9f6-1e9f-45b3-b7d4-5d701ef3daeb tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:06.485541 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-7e37f9f6-1e9f-45b3-b7d4-5d701ef3daeb tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1260 microversion: 2.1 time: 0.182748 Aug 31 12:40:06.487859 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 465/941] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:06 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:07.508866 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-0f758e1e-4100-4ab0-95e4-35d7b9d34b1b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:07.509490 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-0f758e1e-4100-4ab0-95e4-35d7b9d34b1b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:07.516850 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0f758e1e-4100-4ab0-95e4-35d7b9d34b1b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:07.517345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0f758e1e-4100-4ab0-95e4-35d7b9d34b1b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:07.517777 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0f758e1e-4100-4ab0-95e4-35d7b9d34b1b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:07.518480 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0f758e1e-4100-4ab0-95e4-35d7b9d34b1b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:07.518965 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0f758e1e-4100-4ab0-95e4-35d7b9d34b1b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:07.519394 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0f758e1e-4100-4ab0-95e4-35d7b9d34b1b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:07.686017 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-0f758e1e-4100-4ab0-95e4-35d7b9d34b1b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:07.699038 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-0f758e1e-4100-4ab0-95e4-35d7b9d34b1b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1260 microversion: 2.1 time: 0.192574 Aug 31 12:40:07.699994 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 477/942] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:07 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1260 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:08.722886 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-a4bb1634-8ccb-4110-8150-c6bc2bac664e tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:08.723485 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-a4bb1634-8ccb-4110-8150-c6bc2bac664e tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:08.730449 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a4bb1634-8ccb-4110-8150-c6bc2bac664e tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:08.730995 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a4bb1634-8ccb-4110-8150-c6bc2bac664e tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:08.731403 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a4bb1634-8ccb-4110-8150-c6bc2bac664e tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:08.732103 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a4bb1634-8ccb-4110-8150-c6bc2bac664e tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:08.732555 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a4bb1634-8ccb-4110-8150-c6bc2bac664e tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:08.732975 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a4bb1634-8ccb-4110-8150-c6bc2bac664e tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:08.888400 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-a4bb1634-8ccb-4110-8150-c6bc2bac664e tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:08.896739 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-a4bb1634-8ccb-4110-8150-c6bc2bac664e tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1260 microversion: 2.1 time: 0.178166 Aug 31 12:40:08.897333 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 466/943] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:08 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:09.928863 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-56c775e3-10b4-4754-a116-eaf5e2a579b4 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:09.929784 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-56c775e3-10b4-4754-a116-eaf5e2a579b4 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:09.936883 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-56c775e3-10b4-4754-a116-eaf5e2a579b4 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:09.937695 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-56c775e3-10b4-4754-a116-eaf5e2a579b4 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:09.938297 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-56c775e3-10b4-4754-a116-eaf5e2a579b4 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:09.939103 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-56c775e3-10b4-4754-a116-eaf5e2a579b4 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:09.939650 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-56c775e3-10b4-4754-a116-eaf5e2a579b4 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:09.940341 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-56c775e3-10b4-4754-a116-eaf5e2a579b4 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:10.122259 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-56c775e3-10b4-4754-a116-eaf5e2a579b4 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:10.130702 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-56c775e3-10b4-4754-a116-eaf5e2a579b4 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1260 microversion: 2.1 time: 0.206909 Aug 31 12:40:10.131336 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 478/944] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:09 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1260 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:11.153749 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-725c091f-f215-44a4-8728-6d7648e4f813 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:11.154367 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-725c091f-f215-44a4-8728-6d7648e4f813 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:11.161298 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-725c091f-f215-44a4-8728-6d7648e4f813 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:11.161790 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-725c091f-f215-44a4-8728-6d7648e4f813 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:11.162224 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-725c091f-f215-44a4-8728-6d7648e4f813 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:11.162960 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-725c091f-f215-44a4-8728-6d7648e4f813 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:11.163414 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-725c091f-f215-44a4-8728-6d7648e4f813 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:11.163900 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-725c091f-f215-44a4-8728-6d7648e4f813 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:11.324698 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-725c091f-f215-44a4-8728-6d7648e4f813 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:11.340170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-725c091f-f215-44a4-8728-6d7648e4f813 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1260 microversion: 2.1 time: 0.190658 Aug 31 12:40:11.341250 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 467/945] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:11 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1260 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:12.372704 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-da810984-84b1-4537-9e22-b2dc50981c9b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:12.373337 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-da810984-84b1-4537-9e22-b2dc50981c9b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:12.377102 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=2 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:12.382802 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-da810984-84b1-4537-9e22-b2dc50981c9b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:12.383326 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-da810984-84b1-4537-9e22-b2dc50981c9b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:12.383767 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-da810984-84b1-4537-9e22-b2dc50981c9b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:12.384498 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-da810984-84b1-4537-9e22-b2dc50981c9b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:12.385052 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-da810984-84b1-4537-9e22-b2dc50981c9b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:12.385481 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-da810984-84b1-4537-9e22-b2dc50981c9b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:12.554523 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-da810984-84b1-4537-9e22-b2dc50981c9b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:12.567080 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-da810984-84b1-4537-9e22-b2dc50981c9b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1260 microversion: 2.1 time: 0.198281 Aug 31 12:40:12.567804 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 479/946] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:12 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1260 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:13.600586 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-9b2ad103-c9bf-45c2-9e32-e3ff2f3e8446 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:13.601603 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-9b2ad103-c9bf-45c2-9e32-e3ff2f3e8446 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:13.605842 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell0:SELECT=2 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:13.607059 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell0:SELECT=6 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:13.616705 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9b2ad103-c9bf-45c2-9e32-e3ff2f3e8446 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:13.617345 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9b2ad103-c9bf-45c2-9e32-e3ff2f3e8446 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:13.617860 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9b2ad103-c9bf-45c2-9e32-e3ff2f3e8446 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:13.620495 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9b2ad103-c9bf-45c2-9e32-e3ff2f3e8446 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:13.621197 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9b2ad103-c9bf-45c2-9e32-e3ff2f3e8446 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:13.621764 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9b2ad103-c9bf-45c2-9e32-e3ff2f3e8446 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:13.850098 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-9b2ad103-c9bf-45c2-9e32-e3ff2f3e8446 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:13.859156 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-9b2ad103-c9bf-45c2-9e32-e3ff2f3e8446 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1260 microversion: 2.1 time: 0.263674 Aug 31 12:40:13.859654 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 468/947] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:13 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1260 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:14.118112 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-37d143c7-96df-4032-9278-873323c13b54 req-bbe2580b-8356-406a-b41e-df5606e6fc35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68593769-d63a-425c-8988-3def34259a96", "name": "network-vif-plugged", "status": "completed", "tag": "c50ac0a0-bbf4-44a3-9255-25ee8afa88e4"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:40:14.136512 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-37d143c7-96df-4032-9278-873323c13b54 req-bbe2580b-8356-406a-b41e-df5606e6fc35 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:14.137046 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-37d143c7-96df-4032-9278-873323c13b54 req-bbe2580b-8356-406a-b41e-df5606e6fc35 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:14.137700 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-37d143c7-96df-4032-9278-873323c13b54 req-bbe2580b-8356-406a-b41e-df5606e6fc35 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:14.159253 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-37d143c7-96df-4032-9278-873323c13b54 req-bbe2580b-8356-406a-b41e-df5606e6fc35 service nova] Creating event network-vif-plugged:c50ac0a0-bbf4-44a3-9255-25ee8afa88e4 for instance 68593769-d63a-425c-8988-3def34259a96 on hv-cinder-85528 Aug 31 12:40:14.165306 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-37d143c7-96df-4032-9278-873323c13b54 req-bbe2580b-8356-406a-b41e-df5606e6fc35 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051727 Aug 31 12:40:14.166978 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 480/948] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:40:14.589795 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-45320aa8-59ab-47c7-887f-63045088325a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:14.590289 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-45320aa8-59ab-47c7-887f-63045088325a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:14.593795 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-0754c7eb-f3a7-4cd6-b8aa-2586bdb32b5b req-e8dfb0c6-19bf-4a9d-b685-2dd92cccdfa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a96c4a7-b50c-48dc-97be-91c9aae4fc3d", "tag": "a4a552df-b84c-41d7-b76b-420c62afae50"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:40:14.601371 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-45320aa8-59ab-47c7-887f-63045088325a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:14.601969 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-45320aa8-59ab-47c7-887f-63045088325a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:14.602380 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-45320aa8-59ab-47c7-887f-63045088325a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:14.603229 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-45320aa8-59ab-47c7-887f-63045088325a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:14.603863 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-45320aa8-59ab-47c7-887f-63045088325a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:14.604221 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-45320aa8-59ab-47c7-887f-63045088325a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:14.604953 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-0754c7eb-f3a7-4cd6-b8aa-2586bdb32b5b req-e8dfb0c6-19bf-4a9d-b685-2dd92cccdfa8 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:14.605760 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-0754c7eb-f3a7-4cd6-b8aa-2586bdb32b5b req-e8dfb0c6-19bf-4a9d-b685-2dd92cccdfa8 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:14.606366 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-0754c7eb-f3a7-4cd6-b8aa-2586bdb32b5b req-e8dfb0c6-19bf-4a9d-b685-2dd92cccdfa8 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:14.620344 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-0754c7eb-f3a7-4cd6-b8aa-2586bdb32b5b req-e8dfb0c6-19bf-4a9d-b685-2dd92cccdfa8 service nova] Creating event network-changed:a4a552df-b84c-41d7-b76b-420c62afae50 for instance 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d on hv-cinder-85528 Aug 31 12:40:14.625438 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-0754c7eb-f3a7-4cd6-b8aa-2586bdb32b5b req-e8dfb0c6-19bf-4a9d-b685-2dd92cccdfa8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037685 Aug 31 12:40:14.626057 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 481/949] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:40:14.640877 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-45320aa8-59ab-47c7-887f-63045088325a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d] Going to try to terminate instance {{(pid=120750) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:40:14.734825 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-45320aa8-59ab-47c7-887f-63045088325a tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d" status: 204 len: 0 microversion: 2.1 time: 0.149665 Aug 31 12:40:14.735647 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 469/950] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 31 12:40:14 2022] DELETE /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:40:14.746913 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-59904b12-702f-4922-8d3e-556b7673f185 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:14.747621 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-59904b12-702f-4922-8d3e-556b7673f185 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:14.754446 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-59904b12-702f-4922-8d3e-556b7673f185 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:14.754970 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-59904b12-702f-4922-8d3e-556b7673f185 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:14.755413 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-59904b12-702f-4922-8d3e-556b7673f185 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:14.756133 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-59904b12-702f-4922-8d3e-556b7673f185 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:14.756583 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-59904b12-702f-4922-8d3e-556b7673f185 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:14.757009 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-59904b12-702f-4922-8d3e-556b7673f185 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:14.895282 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-60bb3dcc-0889-4fac-bb01-14e06bd2fe03 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:14.896667 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-60bb3dcc-0889-4fac-bb01-14e06bd2fe03 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:14.903629 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-60bb3dcc-0889-4fac-bb01-14e06bd2fe03 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:14.904398 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-60bb3dcc-0889-4fac-bb01-14e06bd2fe03 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:14.904832 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-60bb3dcc-0889-4fac-bb01-14e06bd2fe03 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:14.905535 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-60bb3dcc-0889-4fac-bb01-14e06bd2fe03 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:14.906144 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-60bb3dcc-0889-4fac-bb01-14e06bd2fe03 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:14.906901 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-60bb3dcc-0889-4fac-bb01-14e06bd2fe03 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:14.942528 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-59904b12-702f-4922-8d3e-556b7673f185 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:14.956160 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-59904b12-702f-4922-8d3e-556b7673f185 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d" status: 200 len: 1577 microversion: 2.1 time: 0.213717 Aug 31 12:40:14.957605 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 482/951] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:14 2022] GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d => generated 1577 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:15.079970 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-60bb3dcc-0889-4fac-bb01-14e06bd2fe03 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:15.080657 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-60bb3dcc-0889-4fac-bb01-14e06bd2fe03 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1260 microversion: 2.1 time: 0.193167 Aug 31 12:40:15.081783 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 470/952] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:14 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1260 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:15.893624 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-0d354db4-86a9-4924-99e6-ed8651caec8e tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:15.894168 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-0d354db4-86a9-4924-99e6-ed8651caec8e tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:15.900361 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0d354db4-86a9-4924-99e6-ed8651caec8e tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:15.901473 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0d354db4-86a9-4924-99e6-ed8651caec8e tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:15.901914 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0d354db4-86a9-4924-99e6-ed8651caec8e tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:15.902613 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0d354db4-86a9-4924-99e6-ed8651caec8e tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:15.903109 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0d354db4-86a9-4924-99e6-ed8651caec8e tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:15.903536 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0d354db4-86a9-4924-99e6-ed8651caec8e tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:15.929246 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-0d354db4-86a9-4924-99e6-ed8651caec8e tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8/ips" status: 200 len: 150 microversion: 2.1 time: 0.144941 Aug 31 12:40:15.929810 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 483/953] 10.222.0.79 () {58 vars in 1248 bytes} [Wed Aug 31 12:40:15 2022] GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8/ips => generated 150 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:40:15.981398 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-4563bfc9-bffb-4eb1-bb7a-c44475c0b843 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:15.982384 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-4563bfc9-bffb-4eb1-bb7a-c44475c0b843 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:15.989151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4563bfc9-bffb-4eb1-bb7a-c44475c0b843 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:15.989641 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4563bfc9-bffb-4eb1-bb7a-c44475c0b843 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:15.990078 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4563bfc9-bffb-4eb1-bb7a-c44475c0b843 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:15.990796 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4563bfc9-bffb-4eb1-bb7a-c44475c0b843 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:15.991279 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4563bfc9-bffb-4eb1-bb7a-c44475c0b843 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:15.991701 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4563bfc9-bffb-4eb1-bb7a-c44475c0b843 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:16.104173 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-0e85fcb3-3acb-4322-92c2-3a617f76c236 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:16.105480 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-0e85fcb3-3acb-4322-92c2-3a617f76c236 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:16.113008 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0e85fcb3-3acb-4322-92c2-3a617f76c236 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:16.113813 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0e85fcb3-3acb-4322-92c2-3a617f76c236 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:16.114250 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0e85fcb3-3acb-4322-92c2-3a617f76c236 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:16.115170 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0e85fcb3-3acb-4322-92c2-3a617f76c236 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:16.115764 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0e85fcb3-3acb-4322-92c2-3a617f76c236 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:16.116221 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-0e85fcb3-3acb-4322-92c2-3a617f76c236 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:16.150418 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-4563bfc9-bffb-4eb1-bb7a-c44475c0b843 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:16.163394 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-4563bfc9-bffb-4eb1-bb7a-c44475c0b843 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d" status: 200 len: 1577 microversion: 2.1 time: 0.186220 Aug 31 12:40:16.165730 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 471/954] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:15 2022] GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d => generated 1577 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:16.297469 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-0e85fcb3-3acb-4322-92c2-3a617f76c236 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:16.313257 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-0e85fcb3-3acb-4322-92c2-3a617f76c236 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1260 microversion: 2.1 time: 0.213553 Aug 31 12:40:16.313995 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 484/955] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:16 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1260 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:17.188001 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-25c4c4df-85f7-40af-99aa-0d3230170b22 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:17.188785 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-25c4c4df-85f7-40af-99aa-0d3230170b22 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:17.195249 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-25c4c4df-85f7-40af-99aa-0d3230170b22 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:17.196001 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-25c4c4df-85f7-40af-99aa-0d3230170b22 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:17.196637 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-25c4c4df-85f7-40af-99aa-0d3230170b22 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:17.197857 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-25c4c4df-85f7-40af-99aa-0d3230170b22 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:17.198540 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-25c4c4df-85f7-40af-99aa-0d3230170b22 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:17.199918 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-25c4c4df-85f7-40af-99aa-0d3230170b22 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:17.335898 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-29a97946-4a5c-4c01-9700-53426a3bf2de tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:17.337066 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-29a97946-4a5c-4c01-9700-53426a3bf2de tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:17.348478 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-29a97946-4a5c-4c01-9700-53426a3bf2de tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:17.348949 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-29a97946-4a5c-4c01-9700-53426a3bf2de tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:17.349409 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-29a97946-4a5c-4c01-9700-53426a3bf2de tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:17.353300 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-29a97946-4a5c-4c01-9700-53426a3bf2de tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:17.354966 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-29a97946-4a5c-4c01-9700-53426a3bf2de tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:17.355605 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-29a97946-4a5c-4c01-9700-53426a3bf2de tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:17.435963 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-25c4c4df-85f7-40af-99aa-0d3230170b22 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:17.448810 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-25c4c4df-85f7-40af-99aa-0d3230170b22 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d" status: 200 len: 1577 microversion: 2.1 time: 0.264685 Aug 31 12:40:17.450058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 472/956] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:17 2022] GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d => generated 1577 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:17.455755 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-a9b62a7a-fff2-45e9-a0b3-c2ae4b940d01 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e479f6e4-0e6d-4d16-b7a6-4aea4e5ef656"}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:40:17.458147 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-a9b62a7a-fff2-45e9-a0b3-c2ae4b940d01 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:17.464494 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a9b62a7a-fff2-45e9-a0b3-c2ae4b940d01 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:17.465001 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a9b62a7a-fff2-45e9-a0b3-c2ae4b940d01 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:17.465442 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a9b62a7a-fff2-45e9-a0b3-c2ae4b940d01 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:17.466251 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a9b62a7a-fff2-45e9-a0b3-c2ae4b940d01 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:17.466641 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a9b62a7a-fff2-45e9-a0b3-c2ae4b940d01 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:17.467117 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a9b62a7a-fff2-45e9-a0b3-c2ae4b940d01 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:17.642497 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-29a97946-4a5c-4c01-9700-53426a3bf2de tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:17.658909 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-29a97946-4a5c-4c01-9700-53426a3bf2de tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1445 microversion: 2.1 time: 0.327720 Aug 31 12:40:17.666815 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 485/957] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:17 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1445 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:17.716915 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-52990656-d17d-46ec-ba72-13c7d9251467 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:17.724525 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-52990656-d17d-46ec-ba72-13c7d9251467 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:17.745614 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-52990656-d17d-46ec-ba72-13c7d9251467 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:17.747413 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-52990656-d17d-46ec-ba72-13c7d9251467 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:17.748684 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-52990656-d17d-46ec-ba72-13c7d9251467 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:17.750891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-52990656-d17d-46ec-ba72-13c7d9251467 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:17.752555 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-52990656-d17d-46ec-ba72-13c7d9251467 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:17.753791 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-52990656-d17d-46ec-ba72-13c7d9251467 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:17.895127 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-a9b62a7a-fff2-45e9-a0b3-c2ae4b940d01 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "POST /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.443273 Aug 31 12:40:17.895891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 473/958] 10.222.0.79 () {60 vars in 1323 bytes} [Wed Aug 31 12:40:17 2022] POST /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8/os-volume_attachments => generated 194 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:40:17.935118 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-e1827e83-17c2-4f90-bdbb-87275171e0d2 req-cc71fadc-9c4f-44bc-be44-80f2c9471aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a96c4a7-b50c-48dc-97be-91c9aae4fc3d", "name": "network-vif-deleted", "tag": "a4a552df-b84c-41d7-b76b-420c62afae50"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:40:17.949993 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-e1827e83-17c2-4f90-bdbb-87275171e0d2 req-cc71fadc-9c4f-44bc-be44-80f2c9471aaf service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:17.950659 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-e1827e83-17c2-4f90-bdbb-87275171e0d2 req-cc71fadc-9c4f-44bc-be44-80f2c9471aaf service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:17.951268 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-e1827e83-17c2-4f90-bdbb-87275171e0d2 req-cc71fadc-9c4f-44bc-be44-80f2c9471aaf service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:17.981931 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-e1827e83-17c2-4f90-bdbb-87275171e0d2 req-cc71fadc-9c4f-44bc-be44-80f2c9471aaf service nova] Creating event network-vif-deleted:a4a552df-b84c-41d7-b76b-420c62afae50 for instance 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d on hv-cinder-85528 Aug 31 12:40:18.005218 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-e1827e83-17c2-4f90-bdbb-87275171e0d2 req-cc71fadc-9c4f-44bc-be44-80f2c9471aaf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076653 Aug 31 12:40:18.006239 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 474/959] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:40:18.044466 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-52990656-d17d-46ec-ba72-13c7d9251467 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:18.054187 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-52990656-d17d-46ec-ba72-13c7d9251467 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1445 microversion: 2.1 time: 0.357226 Aug 31 12:40:18.054768 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 486/960] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:17 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1445 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:18.480670 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-4e86bc07-f3c6-4967-a649-77b3e03b7f33 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:18.481369 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-4e86bc07-f3c6-4967-a649-77b3e03b7f33 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:18.488474 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4e86bc07-f3c6-4967-a649-77b3e03b7f33 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:18.488972 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4e86bc07-f3c6-4967-a649-77b3e03b7f33 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:18.489464 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4e86bc07-f3c6-4967-a649-77b3e03b7f33 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:18.490178 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4e86bc07-f3c6-4967-a649-77b3e03b7f33 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:18.490834 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4e86bc07-f3c6-4967-a649-77b3e03b7f33 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:18.491342 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4e86bc07-f3c6-4967-a649-77b3e03b7f33 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:18.525990 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4e86bc07-f3c6-4967-a649-77b3e03b7f33 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:18.526499 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4e86bc07-f3c6-4967-a649-77b3e03b7f33 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:18.526947 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4e86bc07-f3c6-4967-a649-77b3e03b7f33 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:18.527392 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.objects.instance [None req-4e86bc07-f3c6-4967-a649-77b3e03b7f33 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lazy-loading 'fault' on Instance uuid 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d {{(pid=120750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:40:18.577577 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-4e86bc07-f3c6-4967-a649-77b3e03b7f33 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:18.587237 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-4e86bc07-f3c6-4967-a649-77b3e03b7f33 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d" status: 200 len: 1229 microversion: 2.1 time: 0.117193 Aug 31 12:40:18.587857 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 475/961] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:18 2022] GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d => generated 1229 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:19.608893 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-339e8506-e011-4702-9779-b81d1700eb67 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:19.609511 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-339e8506-e011-4702-9779-b81d1700eb67 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:19.615347 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-339e8506-e011-4702-9779-b81d1700eb67 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:19.615862 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-339e8506-e011-4702-9779-b81d1700eb67 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:19.616291 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-339e8506-e011-4702-9779-b81d1700eb67 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:19.616982 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-339e8506-e011-4702-9779-b81d1700eb67 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:19.617430 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-339e8506-e011-4702-9779-b81d1700eb67 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:19.617848 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-339e8506-e011-4702-9779-b81d1700eb67 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:19.633596 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.wsgi [None req-339e8506-e011-4702-9779-b81d1700eb67 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] HTTP exception thrown: Instance 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d could not be found. Aug 31 12:40:19.635340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-339e8506-e011-4702-9779-b81d1700eb67 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Request method failure captured: Aug 31 12:40:19.635340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: request: GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d HTTP/1.1 Aug 31 12:40:19.635340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept: application/json Aug 31 12:40:19.635340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept-Encoding: identity Aug 31 12:40:19.635340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Connection: close Aug 31 12:40:19.635340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Length: 0 Aug 31 12:40:19.635340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Type: application/json Aug 31 12:40:19.635340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Host: 10.222.0.79 Aug 31 12:40:19.635340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Openstack-System-Scope: None Aug 31 12:40:19.635340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: User-Agent: python-urllib3/1.26.12 Aug 31 12:40:19.635340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Auth-Token: gAAAAABjD1TKnJSWeeKQm_1NqqsKqOsHHQXTPzhADDpYcTDRl9mIGATR_iTWyrefkZEIfHAgLtHW8qiHxUYObBzU5-t-1KWBmcNldBVTKMnmykcZ9Bp-C7BOODdG3CAY4lH4U2IWDZSZYpgijrmKIW7NCBig5Dht5VkGDqDZieUVsAv2qfrlf-Q Aug 31 12:40:19.635340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Id: None Aug 31 12:40:19.635340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Name: None Aug 31 12:40:19.635340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Identity-Status: Confirmed Aug 31 12:40:19.635340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Is-Admin-Project: True Aug 31 12:40:19.635340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Id: default Aug 31 12:40:19.635340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Name: Default Aug 31 12:40:19.635340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Id: b364169c30154cc8af7c9a37bebc8040 Aug 31 12:40:19.635340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Name: tempest-TestVolumeBootPattern-12247139 Aug 31 12:40:19.635340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Role: reader,member Aug 31 12:40:19.635340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Roles: reader,member Aug 31 12:40:19.636817 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b364169c30154cc8af7c9a37bebc8040"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b364169c30154cc8af7c9a37bebc8040", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b364169c30154cc8af7c9a37bebc8040"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b364169c30154cc8af7c9a37bebc8040"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:40:19.636817 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant: tempest-TestVolumeBootPattern-12247139 Aug 31 12:40:19.636817 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Id: b364169c30154cc8af7c9a37bebc8040 Aug 31 12:40:19.636817 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Name: tempest-TestVolumeBootPattern-12247139 Aug 31 12:40:19.636817 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User: tempest-TestVolumeBootPattern-12247139-project Aug 31 12:40:19.636817 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Id: default Aug 31 12:40:19.636817 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Name: Default Aug 31 12:40:19.636817 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Id: 2e77671c123f434489d82da79212d0ab Aug 31 12:40:19.636817 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Name: tempest-TestVolumeBootPattern-12247139-project Aug 31 12:40:19.636817 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: method: > Aug 31 12:40:19.636817 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: exception: Instance 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d could not be found. Aug 31 12:40:19.636817 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: action_args: {'id': '7a96c4a7-b50c-48dc-97be-91c9aae4fc3d'} Aug 31 12:40:19.637653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:40:19.637653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:19.637653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:40:19.637653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:40:19.637653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:40:19.637653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:40:19.637653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:40:19.637653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:40:19.637653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:40:19.637653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:40:19.637653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d could not be found. Aug 31 12:40:19.637653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:19.637653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:40:19.637653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:19.637653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:19.637653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:40:19.637653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:40:19.637653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:40:19.637653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:40:19.637653 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:40:19.639115 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:40:19.639115 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:40:19.639115 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:40:19.639115 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:40:19.639115 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:40:19.639115 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:40:19.639115 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:40:19.639115 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d could not be found. Aug 31 12:40:19.639115 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:19.639115 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:40:19.639115 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:19.639115 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:19.639115 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:40:19.639115 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:40:19.639115 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:40:19.639115 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:40:19.639115 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d could not be found. Aug 31 12:40:19.639115 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:19.640348 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-339e8506-e011-4702-9779-b81d1700eb67 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Returning 404 to user: Instance 7a96c4a7-b50c-48dc-97be-91c9aae4fc3d could not be found. {{(pid=120749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:40:19.640348 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-339e8506-e011-4702-9779-b81d1700eb67 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d" status: 404 len: 111 microversion: 2.1 time: 0.032036 Aug 31 12:40:19.640348 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 487/962] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:19 2022] GET /compute/v2.1/servers/7a96c4a7-b50c-48dc-97be-91c9aae4fc3d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:40:20.147785 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-70cc6f64-cba8-4fa4-a704-33eedc416b57 req-57ffe76a-d93c-4203-901f-b79539db4d3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68593769-d63a-425c-8988-3def34259a96", "tag": "c50ac0a0-bbf4-44a3-9255-25ee8afa88e4"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:40:20.158728 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-70cc6f64-cba8-4fa4-a704-33eedc416b57 req-57ffe76a-d93c-4203-901f-b79539db4d3d service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:20.159283 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-70cc6f64-cba8-4fa4-a704-33eedc416b57 req-57ffe76a-d93c-4203-901f-b79539db4d3d service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:20.159716 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-70cc6f64-cba8-4fa4-a704-33eedc416b57 req-57ffe76a-d93c-4203-901f-b79539db4d3d service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:20.172760 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-70cc6f64-cba8-4fa4-a704-33eedc416b57 req-57ffe76a-d93c-4203-901f-b79539db4d3d service nova] Creating event network-changed:c50ac0a0-bbf4-44a3-9255-25ee8afa88e4 for instance 68593769-d63a-425c-8988-3def34259a96 on hv-cinder-85528 Aug 31 12:40:20.177779 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-70cc6f64-cba8-4fa4-a704-33eedc416b57 req-57ffe76a-d93c-4203-901f-b79539db4d3d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035678 Aug 31 12:40:20.178687 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 476/963] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:40:22.795283 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-ee524f5b-1db2-4cbe-836b-4a6a0e2bc27f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:22.795859 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-ee524f5b-1db2-4cbe-836b-4a6a0e2bc27f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:22.798559 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-d638fe70-8878-4a81-a876-cb4c7457c871 req-e043b360-4366-4abb-8eae-ca13a049c4a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf8dc60e-6168-4d8a-b00a-56d3df39acc1", "tag": "5ee12b57-c6ee-4824-a0bc-c435d577bbdd"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:40:22.809443 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ee524f5b-1db2-4cbe-836b-4a6a0e2bc27f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:22.809938 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ee524f5b-1db2-4cbe-836b-4a6a0e2bc27f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:22.810372 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ee524f5b-1db2-4cbe-836b-4a6a0e2bc27f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:22.810804 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-d638fe70-8878-4a81-a876-cb4c7457c871 req-e043b360-4366-4abb-8eae-ca13a049c4a6 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:22.811087 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ee524f5b-1db2-4cbe-836b-4a6a0e2bc27f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:22.811318 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-d638fe70-8878-4a81-a876-cb4c7457c871 req-e043b360-4366-4abb-8eae-ca13a049c4a6 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:22.811537 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ee524f5b-1db2-4cbe-836b-4a6a0e2bc27f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:22.811746 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-d638fe70-8878-4a81-a876-cb4c7457c871 req-e043b360-4366-4abb-8eae-ca13a049c4a6 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:22.811962 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ee524f5b-1db2-4cbe-836b-4a6a0e2bc27f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:22.824670 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-d638fe70-8878-4a81-a876-cb4c7457c871 req-e043b360-4366-4abb-8eae-ca13a049c4a6 service nova] Creating event network-changed:5ee12b57-c6ee-4824-a0bc-c435d577bbdd for instance bf8dc60e-6168-4d8a-b00a-56d3df39acc1 on hv-cinder-85528 Aug 31 12:40:22.830599 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-d638fe70-8878-4a81-a876-cb4c7457c871 req-e043b360-4366-4abb-8eae-ca13a049c4a6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036168 Aug 31 12:40:22.831247 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 477/964] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:40:22.848748 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-ee524f5b-1db2-4cbe-836b-4a6a0e2bc27f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Going to try to terminate instance {{(pid=120749) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:40:22.938103 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-ee524f5b-1db2-4cbe-836b-4a6a0e2bc27f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 204 len: 0 microversion: 2.1 time: 0.146933 Aug 31 12:40:22.941791 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 488/965] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 31 12:40:22 2022] DELETE /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:40:22.949191 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-65bcf6e6-8021-4b52-962d-25604e94845f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:22.950232 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-65bcf6e6-8021-4b52-962d-25604e94845f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:22.956892 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-65bcf6e6-8021-4b52-962d-25604e94845f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:22.957758 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-65bcf6e6-8021-4b52-962d-25604e94845f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:22.958505 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-65bcf6e6-8021-4b52-962d-25604e94845f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:22.959674 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-65bcf6e6-8021-4b52-962d-25604e94845f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:22.960376 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-65bcf6e6-8021-4b52-962d-25604e94845f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:22.961110 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-65bcf6e6-8021-4b52-962d-25604e94845f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:22.981869 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:23.114026 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-65bcf6e6-8021-4b52-962d-25604e94845f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:23.122779 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-65bcf6e6-8021-4b52-962d-25604e94845f tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 200 len: 1576 microversion: 2.1 time: 0.179572 Aug 31 12:40:23.123390 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 478/966] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:22 2022] GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:24.145161 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-69da9957-d9b8-4eeb-8c5e-1e075c671897 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:24.145787 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-69da9957-d9b8-4eeb-8c5e-1e075c671897 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:24.152288 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-69da9957-d9b8-4eeb-8c5e-1e075c671897 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:24.152885 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-69da9957-d9b8-4eeb-8c5e-1e075c671897 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:24.153318 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-69da9957-d9b8-4eeb-8c5e-1e075c671897 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:24.154006 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-69da9957-d9b8-4eeb-8c5e-1e075c671897 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:24.154453 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-69da9957-d9b8-4eeb-8c5e-1e075c671897 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:24.154891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-69da9957-d9b8-4eeb-8c5e-1e075c671897 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:24.319838 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-69da9957-d9b8-4eeb-8c5e-1e075c671897 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:24.327885 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-69da9957-d9b8-4eeb-8c5e-1e075c671897 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 200 len: 1576 microversion: 2.1 time: 0.187060 Aug 31 12:40:24.328444 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 489/967] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:24 2022] GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 1576 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:25.349408 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-bae1d470-3ee0-4f54-ba73-28a0645c56c7 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:25.350536 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-bae1d470-3ee0-4f54-ba73-28a0645c56c7 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:25.358371 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bae1d470-3ee0-4f54-ba73-28a0645c56c7 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:25.358919 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bae1d470-3ee0-4f54-ba73-28a0645c56c7 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:25.359762 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bae1d470-3ee0-4f54-ba73-28a0645c56c7 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:25.360495 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bae1d470-3ee0-4f54-ba73-28a0645c56c7 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:25.360974 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bae1d470-3ee0-4f54-ba73-28a0645c56c7 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:25.361389 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bae1d470-3ee0-4f54-ba73-28a0645c56c7 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:25.447180 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-bae1d470-3ee0-4f54-ba73-28a0645c56c7 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e77671c123f434489d82da79212d0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b364169c30154cc8af7c9a37bebc8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:25.456667 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-bae1d470-3ee0-4f54-ba73-28a0645c56c7 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 200 len: 1389 microversion: 2.1 time: 0.111035 Aug 31 12:40:25.457736 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 479/968] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:25 2022] GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 1389 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:25.494445 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-5664c1d9-1efc-48c2-b026-dbd0b69450b1 req-723c1f61-8607-4f83-9e46-7d97f2944489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf8dc60e-6168-4d8a-b00a-56d3df39acc1", "name": "network-vif-deleted", "tag": "5ee12b57-c6ee-4824-a0bc-c435d577bbdd"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:40:25.504070 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-5664c1d9-1efc-48c2-b026-dbd0b69450b1 req-723c1f61-8607-4f83-9e46-7d97f2944489 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:25.504556 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-5664c1d9-1efc-48c2-b026-dbd0b69450b1 req-723c1f61-8607-4f83-9e46-7d97f2944489 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:25.504991 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-5664c1d9-1efc-48c2-b026-dbd0b69450b1 req-723c1f61-8607-4f83-9e46-7d97f2944489 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:25.516478 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-5664c1d9-1efc-48c2-b026-dbd0b69450b1 req-723c1f61-8607-4f83-9e46-7d97f2944489 service nova] Creating event network-vif-deleted:5ee12b57-c6ee-4824-a0bc-c435d577bbdd for instance bf8dc60e-6168-4d8a-b00a-56d3df39acc1 on hv-cinder-85528 Aug 31 12:40:25.521193 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-5664c1d9-1efc-48c2-b026-dbd0b69450b1 req-723c1f61-8607-4f83-9e46-7d97f2944489 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122438 Aug 31 12:40:25.521808 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 490/969] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:40:25.643904 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b8f06d51-2e69-466a-ba34-b488e2ef811c tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:25.644388 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-b8f06d51-2e69-466a-ba34-b488e2ef811c tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:25.650241 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8f06d51-2e69-466a-ba34-b488e2ef811c tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:25.651438 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8f06d51-2e69-466a-ba34-b488e2ef811c tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:25.651818 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8f06d51-2e69-466a-ba34-b488e2ef811c tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:25.652660 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8f06d51-2e69-466a-ba34-b488e2ef811c tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:25.653110 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8f06d51-2e69-466a-ba34-b488e2ef811c tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:25.653525 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b8f06d51-2e69-466a-ba34-b488e2ef811c tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:25.752020 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.objects.instance [None req-b8f06d51-2e69-466a-ba34-b488e2ef811c tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lazy-loading 'services' on Instance uuid 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 {{(pid=120750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:40:25.838047 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b8f06d51-2e69-466a-ba34-b488e2ef811c tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8/os-volume_attachments/e479f6e4-0e6d-4d16-b7a6-4aea4e5ef656" status: 202 len: 0 microversion: 2.1 time: 0.197912 Aug 31 12:40:25.839977 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 480/970] 10.222.0.79 () {58 vars in 1416 bytes} [Wed Aug 31 12:40:25 2022] DELETE /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8/os-volume_attachments/e479f6e4-0e6d-4d16-b7a6-4aea4e5ef656 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:40:25.853830 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-d84fe5b0-d2b5-43d2-b678-9fc365da0455 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:25.856725 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-d84fe5b0-d2b5-43d2-b678-9fc365da0455 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:25.868306 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d84fe5b0-d2b5-43d2-b678-9fc365da0455 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:25.868805 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d84fe5b0-d2b5-43d2-b678-9fc365da0455 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:25.869545 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d84fe5b0-d2b5-43d2-b678-9fc365da0455 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:25.870242 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d84fe5b0-d2b5-43d2-b678-9fc365da0455 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:25.870695 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d84fe5b0-d2b5-43d2-b678-9fc365da0455 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:25.871149 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d84fe5b0-d2b5-43d2-b678-9fc365da0455 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:25.901167 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-d84fe5b0-d2b5-43d2-b678-9fc365da0455 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051262 Aug 31 12:40:25.901729 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 491/971] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 31 12:40:25 2022] GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:40:26.480245 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-9279cbea-fedf-44eb-842c-7eb0af348627 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:26.480969 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-9279cbea-fedf-44eb-842c-7eb0af348627 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: bf8dc60e-6168-4d8a-b00a-56d3df39acc1] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:26.486970 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9279cbea-fedf-44eb-842c-7eb0af348627 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:26.487454 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9279cbea-fedf-44eb-842c-7eb0af348627 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:26.487879 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9279cbea-fedf-44eb-842c-7eb0af348627 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:26.488561 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9279cbea-fedf-44eb-842c-7eb0af348627 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:26.489003 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9279cbea-fedf-44eb-842c-7eb0af348627 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:26.489417 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-9279cbea-fedf-44eb-842c-7eb0af348627 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:26.503964 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-9279cbea-fedf-44eb-842c-7eb0af348627 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] HTTP exception thrown: Instance bf8dc60e-6168-4d8a-b00a-56d3df39acc1 could not be found. Aug 31 12:40:26.505722 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-9279cbea-fedf-44eb-842c-7eb0af348627 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Request method failure captured: Aug 31 12:40:26.505722 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 HTTP/1.1 Aug 31 12:40:26.505722 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:40:26.505722 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:40:26.505722 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:40:26.505722 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 0 Aug 31 12:40:26.505722 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:40:26.505722 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:40:26.505722 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:40:26.505722 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:40:26.505722 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1TKnJSWeeKQm_1NqqsKqOsHHQXTPzhADDpYcTDRl9mIGATR_iTWyrefkZEIfHAgLtHW8qiHxUYObBzU5-t-1KWBmcNldBVTKMnmykcZ9Bp-C7BOODdG3CAY4lH4U2IWDZSZYpgijrmKIW7NCBig5Dht5VkGDqDZieUVsAv2qfrlf-Q Aug 31 12:40:26.505722 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:40:26.505722 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:40:26.505722 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:40:26.505722 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:40:26.505722 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:40:26.505722 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:40:26.505722 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: b364169c30154cc8af7c9a37bebc8040 Aug 31 12:40:26.505722 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-TestVolumeBootPattern-12247139 Aug 31 12:40:26.505722 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:40:26.505722 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:40:26.507491 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b364169c30154cc8af7c9a37bebc8040"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b364169c30154cc8af7c9a37bebc8040", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b364169c30154cc8af7c9a37bebc8040"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b364169c30154cc8af7c9a37bebc8040"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:40:26.507491 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-TestVolumeBootPattern-12247139 Aug 31 12:40:26.507491 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: b364169c30154cc8af7c9a37bebc8040 Aug 31 12:40:26.507491 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-TestVolumeBootPattern-12247139 Aug 31 12:40:26.507491 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-TestVolumeBootPattern-12247139-project Aug 31 12:40:26.507491 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:40:26.507491 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:40:26.507491 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: 2e77671c123f434489d82da79212d0ab Aug 31 12:40:26.507491 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-TestVolumeBootPattern-12247139-project Aug 31 12:40:26.507491 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:40:26.507491 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Instance bf8dc60e-6168-4d8a-b00a-56d3df39acc1 could not be found. Aug 31 12:40:26.507491 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'id': 'bf8dc60e-6168-4d8a-b00a-56d3df39acc1'} Aug 31 12:40:26.508504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:40:26.508504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:26.508504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:40:26.508504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:40:26.508504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:40:26.508504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:40:26.508504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:40:26.508504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:40:26.508504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:40:26.508504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:40:26.508504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf8dc60e-6168-4d8a-b00a-56d3df39acc1 could not be found. Aug 31 12:40:26.508504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:26.508504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:40:26.508504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:26.508504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:26.508504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:40:26.508504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:40:26.508504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:40:26.508504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:40:26.508504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:40:26.510433 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:40:26.510433 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:40:26.510433 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:40:26.510433 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:40:26.510433 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:40:26.510433 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:40:26.510433 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:40:26.510433 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf8dc60e-6168-4d8a-b00a-56d3df39acc1 could not be found. Aug 31 12:40:26.510433 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:26.510433 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:40:26.510433 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:26.510433 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:26.510433 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:40:26.510433 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:40:26.510433 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:40:26.510433 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:40:26.510433 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf8dc60e-6168-4d8a-b00a-56d3df39acc1 could not be found. Aug 31 12:40:26.510433 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:26.511855 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-9279cbea-fedf-44eb-842c-7eb0af348627 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Returning 404 to user: Instance bf8dc60e-6168-4d8a-b00a-56d3df39acc1 could not be found. {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:40:26.511855 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-9279cbea-fedf-44eb-842c-7eb0af348627 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1" status: 404 len: 111 microversion: 2.1 time: 0.032159 Aug 31 12:40:26.511855 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 481/972] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:26 2022] GET /compute/v2.1/servers/bf8dc60e-6168-4d8a-b00a-56d3df39acc1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:40:26.913920 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-d524f105-755d-40d2-b173-f4d8d1d0e23e tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:26.916006 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-d524f105-755d-40d2-b173-f4d8d1d0e23e tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:26.922663 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d524f105-755d-40d2-b173-f4d8d1d0e23e tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:26.923321 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d524f105-755d-40d2-b173-f4d8d1d0e23e tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:26.923754 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d524f105-755d-40d2-b173-f4d8d1d0e23e tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:26.924447 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d524f105-755d-40d2-b173-f4d8d1d0e23e tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:26.924897 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d524f105-755d-40d2-b173-f4d8d1d0e23e tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:26.925314 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d524f105-755d-40d2-b173-f4d8d1d0e23e tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:26.951432 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:26.956184 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-d524f105-755d-40d2-b173-f4d8d1d0e23e tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046473 Aug 31 12:40:26.956765 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 492/973] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 31 12:40:26 2022] GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 12:40:26.987900 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-7605d4e9-c259-4e41-bf2e-f1b3a92ca1af tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:26.988464 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-7605d4e9-c259-4e41-bf2e-f1b3a92ca1af tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:26.994976 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7605d4e9-c259-4e41-bf2e-f1b3a92ca1af tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:26.995613 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7605d4e9-c259-4e41-bf2e-f1b3a92ca1af tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:26.996114 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7605d4e9-c259-4e41-bf2e-f1b3a92ca1af tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:26.996888 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7605d4e9-c259-4e41-bf2e-f1b3a92ca1af tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:26.997420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7605d4e9-c259-4e41-bf2e-f1b3a92ca1af tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:26.997923 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7605d4e9-c259-4e41-bf2e-f1b3a92ca1af tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:27.012565 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-7605d4e9-c259-4e41-bf2e-f1b3a92ca1af tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] HTTP exception thrown: Instance 688b1262-46e9-4330-b633-05fc6a28cee3 could not be found. Aug 31 12:40:27.014114 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-7605d4e9-c259-4e41-bf2e-f1b3a92ca1af tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Request method failure captured: Aug 31 12:40:27.014114 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: DELETE /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 HTTP/1.1 Aug 31 12:40:27.014114 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:40:27.014114 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:40:27.014114 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:40:27.014114 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 0 Aug 31 12:40:27.014114 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:40:27.014114 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:40:27.014114 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:40:27.014114 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:40:27.014114 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1TKnJSWeeKQm_1NqqsKqOsHHQXTPzhADDpYcTDRl9mIGATR_iTWyrefkZEIfHAgLtHW8qiHxUYObBzU5-t-1KWBmcNldBVTKMnmykcZ9Bp-C7BOODdG3CAY4lH4U2IWDZSZYpgijrmKIW7NCBig5Dht5VkGDqDZieUVsAv2qfrlf-Q Aug 31 12:40:27.014114 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:40:27.014114 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:40:27.014114 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:40:27.014114 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:40:27.014114 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:40:27.014114 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:40:27.014114 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: b364169c30154cc8af7c9a37bebc8040 Aug 31 12:40:27.014114 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-TestVolumeBootPattern-12247139 Aug 31 12:40:27.014114 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:40:27.014114 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:40:27.015917 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b364169c30154cc8af7c9a37bebc8040"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b364169c30154cc8af7c9a37bebc8040", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b364169c30154cc8af7c9a37bebc8040"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b364169c30154cc8af7c9a37bebc8040"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:40:27.015917 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-TestVolumeBootPattern-12247139 Aug 31 12:40:27.015917 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: b364169c30154cc8af7c9a37bebc8040 Aug 31 12:40:27.015917 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-TestVolumeBootPattern-12247139 Aug 31 12:40:27.015917 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-TestVolumeBootPattern-12247139-project Aug 31 12:40:27.015917 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:40:27.015917 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:40:27.015917 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: 2e77671c123f434489d82da79212d0ab Aug 31 12:40:27.015917 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-TestVolumeBootPattern-12247139-project Aug 31 12:40:27.015917 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:40:27.015917 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Instance 688b1262-46e9-4330-b633-05fc6a28cee3 could not be found. Aug 31 12:40:27.015917 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'id': '688b1262-46e9-4330-b633-05fc6a28cee3'} Aug 31 12:40:27.016963 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:40:27.016963 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:27.016963 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:40:27.016963 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:40:27.016963 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:40:27.016963 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:40:27.016963 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:40:27.016963 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:40:27.016963 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:40:27.016963 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:40:27.016963 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 688b1262-46e9-4330-b633-05fc6a28cee3 could not be found. Aug 31 12:40:27.016963 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:27.016963 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:40:27.016963 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:27.016963 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:27.016963 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:40:27.016963 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:40:27.016963 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:40:27.016963 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:40:27.016963 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:40:27.018616 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:40:27.018616 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 12:40:27.018616 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 12:40:27.018616 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 12:40:27.018616 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 12:40:27.018616 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:40:27.018616 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:40:27.018616 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:40:27.018616 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:40:27.018616 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 688b1262-46e9-4330-b633-05fc6a28cee3 could not be found. Aug 31 12:40:27.018616 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:27.018616 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:40:27.018616 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:27.018616 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:27.018616 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:40:27.018616 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:40:27.018616 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:40:27.018616 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:40:27.018616 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 688b1262-46e9-4330-b633-05fc6a28cee3 could not be found. Aug 31 12:40:27.018616 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:27.020719 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-7605d4e9-c259-4e41-bf2e-f1b3a92ca1af tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Returning 404 to user: Instance 688b1262-46e9-4330-b633-05fc6a28cee3 could not be found. {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:40:27.020719 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-7605d4e9-c259-4e41-bf2e-f1b3a92ca1af tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "DELETE /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 404 len: 111 microversion: 2.1 time: 0.031617 Aug 31 12:40:27.020719 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 482/974] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 31 12:40:26 2022] DELETE /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:40:27.024396 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-d4986f3d-c977-4eba-aa71-242ee13fbcba tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:27.024908 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-d4986f3d-c977-4eba-aa71-242ee13fbcba tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:27.027979 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-9de69466-1aa9-44f1-97db-f23a3ea9edbf tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:27.028678 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-9de69466-1aa9-44f1-97db-f23a3ea9edbf tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] [instance: 688b1262-46e9-4330-b633-05fc6a28cee3] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:27.031786 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d4986f3d-c977-4eba-aa71-242ee13fbcba tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:27.032592 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d4986f3d-c977-4eba-aa71-242ee13fbcba tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:27.032731 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d4986f3d-c977-4eba-aa71-242ee13fbcba tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:27.033370 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d4986f3d-c977-4eba-aa71-242ee13fbcba tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:27.033815 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d4986f3d-c977-4eba-aa71-242ee13fbcba tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:27.034229 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d4986f3d-c977-4eba-aa71-242ee13fbcba tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:27.037710 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9de69466-1aa9-44f1-97db-f23a3ea9edbf tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:27.038325 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9de69466-1aa9-44f1-97db-f23a3ea9edbf tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:27.039278 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9de69466-1aa9-44f1-97db-f23a3ea9edbf tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:27.040190 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9de69466-1aa9-44f1-97db-f23a3ea9edbf tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:27.040747 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9de69466-1aa9-44f1-97db-f23a3ea9edbf tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:27.041247 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9de69466-1aa9-44f1-97db-f23a3ea9edbf tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:27.055643 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.wsgi [None req-9de69466-1aa9-44f1-97db-f23a3ea9edbf tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] HTTP exception thrown: Instance 688b1262-46e9-4330-b633-05fc6a28cee3 could not be found. Aug 31 12:40:27.057416 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-9de69466-1aa9-44f1-97db-f23a3ea9edbf tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Request method failure captured: Aug 31 12:40:27.057416 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: request: GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 HTTP/1.1 Aug 31 12:40:27.057416 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept: application/json Aug 31 12:40:27.057416 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept-Encoding: identity Aug 31 12:40:27.057416 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Connection: close Aug 31 12:40:27.057416 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Length: 0 Aug 31 12:40:27.057416 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Type: application/json Aug 31 12:40:27.057416 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Host: 10.222.0.79 Aug 31 12:40:27.057416 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Openstack-System-Scope: None Aug 31 12:40:27.057416 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: User-Agent: python-urllib3/1.26.12 Aug 31 12:40:27.057416 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Auth-Token: gAAAAABjD1TKnJSWeeKQm_1NqqsKqOsHHQXTPzhADDpYcTDRl9mIGATR_iTWyrefkZEIfHAgLtHW8qiHxUYObBzU5-t-1KWBmcNldBVTKMnmykcZ9Bp-C7BOODdG3CAY4lH4U2IWDZSZYpgijrmKIW7NCBig5Dht5VkGDqDZieUVsAv2qfrlf-Q Aug 31 12:40:27.057416 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Id: None Aug 31 12:40:27.057416 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Name: None Aug 31 12:40:27.057416 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Identity-Status: Confirmed Aug 31 12:40:27.057416 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Is-Admin-Project: True Aug 31 12:40:27.057416 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Id: default Aug 31 12:40:27.057416 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Name: Default Aug 31 12:40:27.057416 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Id: b364169c30154cc8af7c9a37bebc8040 Aug 31 12:40:27.057416 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Name: tempest-TestVolumeBootPattern-12247139 Aug 31 12:40:27.057416 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Role: reader,member Aug 31 12:40:27.057416 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Roles: reader,member Aug 31 12:40:27.059295 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b364169c30154cc8af7c9a37bebc8040"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b364169c30154cc8af7c9a37bebc8040", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b364169c30154cc8af7c9a37bebc8040"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b364169c30154cc8af7c9a37bebc8040"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:40:27.059295 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant: tempest-TestVolumeBootPattern-12247139 Aug 31 12:40:27.059295 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Id: b364169c30154cc8af7c9a37bebc8040 Aug 31 12:40:27.059295 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Name: tempest-TestVolumeBootPattern-12247139 Aug 31 12:40:27.059295 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User: tempest-TestVolumeBootPattern-12247139-project Aug 31 12:40:27.059295 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Id: default Aug 31 12:40:27.059295 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Name: Default Aug 31 12:40:27.059295 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Id: 2e77671c123f434489d82da79212d0ab Aug 31 12:40:27.059295 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Name: tempest-TestVolumeBootPattern-12247139-project Aug 31 12:40:27.059295 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: method: > Aug 31 12:40:27.059295 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: exception: Instance 688b1262-46e9-4330-b633-05fc6a28cee3 could not be found. Aug 31 12:40:27.059295 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: action_args: {'id': '688b1262-46e9-4330-b633-05fc6a28cee3'} Aug 31 12:40:27.060274 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:40:27.060274 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:27.060274 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:40:27.060274 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:40:27.060274 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:40:27.060274 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:40:27.060274 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:40:27.060274 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:40:27.060274 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:40:27.060274 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:40:27.060274 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 688b1262-46e9-4330-b633-05fc6a28cee3 could not be found. Aug 31 12:40:27.060274 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:27.060274 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:40:27.060274 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:27.060274 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:27.060274 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:40:27.060274 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:40:27.060274 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:40:27.060274 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:40:27.060274 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:40:27.061724 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:40:27.061724 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:40:27.061724 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:40:27.061724 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:40:27.061724 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:40:27.061724 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:40:27.061724 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:40:27.061724 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 688b1262-46e9-4330-b633-05fc6a28cee3 could not be found. Aug 31 12:40:27.061724 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:27.061724 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:40:27.061724 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:27.061724 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:27.061724 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:40:27.061724 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:40:27.061724 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:40:27.061724 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:40:27.061724 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 688b1262-46e9-4330-b633-05fc6a28cee3 could not be found. Aug 31 12:40:27.061724 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:27.063001 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-9de69466-1aa9-44f1-97db-f23a3ea9edbf tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Returning 404 to user: Instance 688b1262-46e9-4330-b633-05fc6a28cee3 could not be found. {{(pid=120749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:40:27.063099 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-d4986f3d-c977-4eba-aa71-242ee13fbcba tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8] Going to try to terminate instance {{(pid=120750) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:40:27.063196 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-9de69466-1aa9-44f1-97db-f23a3ea9edbf tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3" status: 404 len: 111 microversion: 2.1 time: 0.038826 Aug 31 12:40:27.063196 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 493/975] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:27 2022] GET /compute/v2.1/servers/688b1262-46e9-4330-b633-05fc6a28cee3 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:40:27.141379 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-d4986f3d-c977-4eba-aa71-242ee13fbcba tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8" status: 204 len: 0 microversion: 2.1 time: 0.120517 Aug 31 12:40:27.142450 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 483/976] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 31 12:40:27 2022] DELETE /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:40:27.151516 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-366cf1b3-a56e-4b19-9976-844fa60c6c52 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:27.152273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-366cf1b3-a56e-4b19-9976-844fa60c6c52 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:27.158730 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-366cf1b3-a56e-4b19-9976-844fa60c6c52 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:27.159250 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-366cf1b3-a56e-4b19-9976-844fa60c6c52 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:27.159685 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-366cf1b3-a56e-4b19-9976-844fa60c6c52 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:27.160450 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-366cf1b3-a56e-4b19-9976-844fa60c6c52 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:27.160905 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-366cf1b3-a56e-4b19-9976-844fa60c6c52 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:27.161326 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-366cf1b3-a56e-4b19-9976-844fa60c6c52 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:27.301448 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-366cf1b3-a56e-4b19-9976-844fa60c6c52 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:27.310239 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-366cf1b3-a56e-4b19-9976-844fa60c6c52 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8" status: 200 len: 1680 microversion: 2.1 time: 0.163659 Aug 31 12:40:27.310835 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 494/977] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:27 2022] GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:28.334201 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-29878910-e8e6-4e23-82b9-682aff35087a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:28.335020 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-29878910-e8e6-4e23-82b9-682aff35087a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:28.343294 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-29878910-e8e6-4e23-82b9-682aff35087a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:28.343808 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-29878910-e8e6-4e23-82b9-682aff35087a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:28.344458 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-29878910-e8e6-4e23-82b9-682aff35087a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:28.345227 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-29878910-e8e6-4e23-82b9-682aff35087a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:28.345669 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-29878910-e8e6-4e23-82b9-682aff35087a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:28.346094 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-29878910-e8e6-4e23-82b9-682aff35087a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:28.373650 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-b13b4a90-802d-4058-a5fb-5d1d05daac44 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] Calling method '.version_select at 0x7f8d16ff75e0>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:28.402317 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-b13b4a90-802d-4058-a5fb-5d1d05daac44 tempest-TestVolumeBootPattern-12247139 tempest-TestVolumeBootPattern-12247139-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-280733761" status: 202 len: 0 microversion: 2.1 time: 0.033891 Aug 31 12:40:28.402949 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 495/978] 10.222.0.79 () {58 vars in 1260 bytes} [Wed Aug 31 12:40:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-280733761 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 12:40:28.500346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-29878910-e8e6-4e23-82b9-682aff35087a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:28.508085 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-29878910-e8e6-4e23-82b9-682aff35087a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8" status: 200 len: 1680 microversion: 2.1 time: 0.178148 Aug 31 12:40:28.508740 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 484/979] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:28 2022] GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:29.530489 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-8305a4ed-ec84-45ce-8fa6-53030a2d56a2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:29.531769 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-8305a4ed-ec84-45ce-8fa6-53030a2d56a2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:29.544106 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8305a4ed-ec84-45ce-8fa6-53030a2d56a2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:29.544891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8305a4ed-ec84-45ce-8fa6-53030a2d56a2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:29.545509 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8305a4ed-ec84-45ce-8fa6-53030a2d56a2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:29.546410 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8305a4ed-ec84-45ce-8fa6-53030a2d56a2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:29.547159 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8305a4ed-ec84-45ce-8fa6-53030a2d56a2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:29.547758 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8305a4ed-ec84-45ce-8fa6-53030a2d56a2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:29.627445 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8305a4ed-ec84-45ce-8fa6-53030a2d56a2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd277532df42244c693b5e51e9fd0c459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6da846ab4f45a6ac4b2e34bf52abfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:29.636503 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-8305a4ed-ec84-45ce-8fa6-53030a2d56a2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8" status: 200 len: 1613 microversion: 2.1 time: 0.110953 Aug 31 12:40:29.638181 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 496/980] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:29 2022] GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 => generated 1613 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:29.762140 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-f0920cd9-49f2-41de-9412-d6b8bcd376d3 req-1e0c1d8e-e003-4024-8630-ca962091f4cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8", "name": "network-vif-deleted", "tag": "ca849947-e6cc-41a0-8120-9cec92cdb0e2"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:40:29.773497 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-f0920cd9-49f2-41de-9412-d6b8bcd376d3 req-1e0c1d8e-e003-4024-8630-ca962091f4cd service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:29.774274 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-f0920cd9-49f2-41de-9412-d6b8bcd376d3 req-1e0c1d8e-e003-4024-8630-ca962091f4cd service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:29.774704 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-f0920cd9-49f2-41de-9412-d6b8bcd376d3 req-1e0c1d8e-e003-4024-8630-ca962091f4cd service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:29.789163 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-f0920cd9-49f2-41de-9412-d6b8bcd376d3 req-1e0c1d8e-e003-4024-8630-ca962091f4cd service nova] Creating event network-vif-deleted:ca849947-e6cc-41a0-8120-9cec92cdb0e2 for instance 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 on hv-cinder-85528 Aug 31 12:40:29.794542 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-f0920cd9-49f2-41de-9412-d6b8bcd376d3 req-1e0c1d8e-e003-4024-8630-ca962091f4cd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036596 Aug 31 12:40:29.795454 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 485/981] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:40:30.660104 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-9cb98b97-a31b-4673-85c7-c051066be418 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:30.660725 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-9cb98b97-a31b-4673-85c7-c051066be418 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:30.668379 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9cb98b97-a31b-4673-85c7-c051066be418 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:30.668878 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9cb98b97-a31b-4673-85c7-c051066be418 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:30.669348 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9cb98b97-a31b-4673-85c7-c051066be418 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:30.670068 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9cb98b97-a31b-4673-85c7-c051066be418 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:30.670522 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9cb98b97-a31b-4673-85c7-c051066be418 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:30.671207 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-9cb98b97-a31b-4673-85c7-c051066be418 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:30.690541 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.wsgi [None req-9cb98b97-a31b-4673-85c7-c051066be418 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] HTTP exception thrown: Instance 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 could not be found. Aug 31 12:40:30.692877 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-9cb98b97-a31b-4673-85c7-c051066be418 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Request method failure captured: Aug 31 12:40:30.692877 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: request: GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 HTTP/1.1 Aug 31 12:40:30.692877 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept: application/json Aug 31 12:40:30.692877 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept-Encoding: identity Aug 31 12:40:30.692877 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Connection: close Aug 31 12:40:30.692877 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Length: 0 Aug 31 12:40:30.692877 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Type: application/json Aug 31 12:40:30.692877 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Host: 10.222.0.79 Aug 31 12:40:30.692877 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Openstack-System-Scope: None Aug 31 12:40:30.692877 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: User-Agent: python-urllib3/1.26.12 Aug 31 12:40:30.692877 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Auth-Token: gAAAAABjD1WA4hDI1B8mwzFgw9UjF0bHYxh-W0PYTg_8OeWEX87GiaZzZhuOr6eQtJ_dbJdWxGbnvcJjpQHDWtPVijl1hs_KhQSiluyTrf3Gs1WSceTlpv-MeDVwBqGReHlFVzM62nzVejCXNhnFRVyOFKPna_2ISD5If38YADpegsr8a3mNzBI Aug 31 12:40:30.692877 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Id: None Aug 31 12:40:30.692877 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Name: None Aug 31 12:40:30.692877 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Identity-Status: Confirmed Aug 31 12:40:30.692877 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Is-Admin-Project: True Aug 31 12:40:30.692877 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Id: default Aug 31 12:40:30.692877 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Name: Default Aug 31 12:40:30.692877 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Id: 8f6da846ab4f45a6ac4b2e34bf52abfc Aug 31 12:40:30.692877 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Name: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:40:30.692877 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Role: reader,member Aug 31 12:40:30.692877 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Roles: reader,member Aug 31 12:40:30.694345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8f6da846ab4f45a6ac4b2e34bf52abfc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:40:30.694345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:40:30.694345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Id: 8f6da846ab4f45a6ac4b2e34bf52abfc Aug 31 12:40:30.694345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:40:30.694345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User: tempest-AttachVolumeNegativeTest-2001270308-project Aug 31 12:40:30.694345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Id: default Aug 31 12:40:30.694345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Name: Default Aug 31 12:40:30.694345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Id: d277532df42244c693b5e51e9fd0c459 Aug 31 12:40:30.694345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Name: tempest-AttachVolumeNegativeTest-2001270308-project Aug 31 12:40:30.694345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: method: > Aug 31 12:40:30.694345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: exception: Instance 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 could not be found. Aug 31 12:40:30.694345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: action_args: {'id': '9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8'} Aug 31 12:40:30.695273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:40:30.695273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:30.695273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:40:30.695273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:40:30.695273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:40:30.695273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:40:30.695273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:40:30.695273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:40:30.695273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:40:30.695273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:40:30.695273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 could not be found. Aug 31 12:40:30.695273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:30.695273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:40:30.695273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:30.695273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:30.695273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:40:30.695273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:40:30.695273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:40:30.695273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:40:30.695273 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:40:30.696571 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:40:30.696571 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:40:30.696571 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:40:30.696571 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:40:30.696571 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:40:30.696571 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:40:30.696571 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:40:30.696571 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 could not be found. Aug 31 12:40:30.696571 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:30.696571 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:40:30.696571 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:30.696571 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:30.696571 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:40:30.696571 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:40:30.696571 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:40:30.696571 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:40:30.696571 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 could not be found. Aug 31 12:40:30.696571 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:30.698484 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-9cb98b97-a31b-4673-85c7-c051066be418 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Returning 404 to user: Instance 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 could not be found. {{(pid=120749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:40:30.698484 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-9cb98b97-a31b-4673-85c7-c051066be418 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8" status: 404 len: 111 microversion: 2.1 time: 0.038492 Aug 31 12:40:30.704939 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-f968dff2-b6a7-49f7-b57c-eae06c99bd1b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '.version_select at 0x7f8d171ff940>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:30.709283 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 497/982] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:30 2022] GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:40:30.729357 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-f968dff2-b6a7-49f7-b57c-eae06c99bd1b tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-458177480" status: 202 len: 0 microversion: 2.1 time: 0.028533 Aug 31 12:40:30.730677 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 486/983] 10.222.0.79 () {58 vars in 1218 bytes} [Wed Aug 31 12:40:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-458177480 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:40:32.962649 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-5a76d25b-ba45-4801-8f4e-c08f585dc2a9 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:32.963269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-5a76d25b-ba45-4801-8f4e-c08f585dc2a9 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:32.965763 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:32.971234 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5a76d25b-ba45-4801-8f4e-c08f585dc2a9 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:32.971726 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5a76d25b-ba45-4801-8f4e-c08f585dc2a9 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:32.972180 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5a76d25b-ba45-4801-8f4e-c08f585dc2a9 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:32.972860 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5a76d25b-ba45-4801-8f4e-c08f585dc2a9 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:32.973314 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5a76d25b-ba45-4801-8f4e-c08f585dc2a9 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:32.973736 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5a76d25b-ba45-4801-8f4e-c08f585dc2a9 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:32.996488 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.wsgi [None req-5a76d25b-ba45-4801-8f4e-c08f585dc2a9 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] HTTP exception thrown: Instance 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 could not be found. Aug 31 12:40:32.999553 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-5a76d25b-ba45-4801-8f4e-c08f585dc2a9 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Request method failure captured: Aug 31 12:40:32.999553 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: request: DELETE /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 HTTP/1.1 Aug 31 12:40:32.999553 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept: application/json Aug 31 12:40:32.999553 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept-Encoding: identity Aug 31 12:40:32.999553 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Connection: close Aug 31 12:40:32.999553 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Length: 0 Aug 31 12:40:32.999553 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Type: application/json Aug 31 12:40:32.999553 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Host: 10.222.0.79 Aug 31 12:40:32.999553 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Openstack-System-Scope: None Aug 31 12:40:32.999553 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: User-Agent: python-urllib3/1.26.12 Aug 31 12:40:32.999553 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Auth-Token: gAAAAABjD1WA4hDI1B8mwzFgw9UjF0bHYxh-W0PYTg_8OeWEX87GiaZzZhuOr6eQtJ_dbJdWxGbnvcJjpQHDWtPVijl1hs_KhQSiluyTrf3Gs1WSceTlpv-MeDVwBqGReHlFVzM62nzVejCXNhnFRVyOFKPna_2ISD5If38YADpegsr8a3mNzBI Aug 31 12:40:32.999553 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Id: None Aug 31 12:40:32.999553 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Name: None Aug 31 12:40:32.999553 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Identity-Status: Confirmed Aug 31 12:40:32.999553 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Is-Admin-Project: True Aug 31 12:40:32.999553 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Id: default Aug 31 12:40:32.999553 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Name: Default Aug 31 12:40:32.999553 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Id: 8f6da846ab4f45a6ac4b2e34bf52abfc Aug 31 12:40:32.999553 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Name: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:40:32.999553 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Role: reader,member Aug 31 12:40:32.999553 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Roles: reader,member Aug 31 12:40:33.001075 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8f6da846ab4f45a6ac4b2e34bf52abfc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:40:33.001075 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:40:33.001075 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Id: 8f6da846ab4f45a6ac4b2e34bf52abfc Aug 31 12:40:33.001075 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:40:33.001075 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User: tempest-AttachVolumeNegativeTest-2001270308-project Aug 31 12:40:33.001075 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Id: default Aug 31 12:40:33.001075 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Name: Default Aug 31 12:40:33.001075 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Id: d277532df42244c693b5e51e9fd0c459 Aug 31 12:40:33.001075 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Name: tempest-AttachVolumeNegativeTest-2001270308-project Aug 31 12:40:33.001075 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: method: > Aug 31 12:40:33.001075 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: exception: Instance 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 could not be found. Aug 31 12:40:33.001075 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: action_args: {'id': '9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8'} Aug 31 12:40:33.002460 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:40:33.002460 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:33.002460 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:40:33.002460 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:40:33.002460 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:40:33.002460 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:40:33.002460 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:40:33.002460 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:40:33.002460 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:40:33.002460 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:40:33.002460 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 could not be found. Aug 31 12:40:33.002460 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:33.002460 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:40:33.002460 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:33.002460 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:33.002460 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:40:33.002460 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:40:33.002460 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:40:33.002460 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:40:33.002460 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:40:33.003863 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:40:33.003863 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 12:40:33.003863 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 12:40:33.003863 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 12:40:33.003863 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 12:40:33.003863 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:40:33.003863 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:40:33.003863 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:40:33.003863 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:40:33.003863 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 could not be found. Aug 31 12:40:33.003863 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:33.003863 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:40:33.003863 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:33.003863 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:33.003863 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:40:33.003863 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:40:33.003863 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:40:33.003863 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:40:33.003863 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 could not be found. Aug 31 12:40:33.003863 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:33.005195 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-5a76d25b-ba45-4801-8f4e-c08f585dc2a9 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Returning 404 to user: Instance 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 could not be found. {{(pid=120749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:40:33.005195 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-5a76d25b-ba45-4801-8f4e-c08f585dc2a9 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8" status: 404 len: 111 microversion: 2.1 time: 0.043425 Aug 31 12:40:33.005195 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 498/984] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 31 12:40:32 2022] DELETE /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:40:33.020409 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b05e4c9e-889b-4ece-adce-b38dcfd8dd19 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:33.021307 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-b05e4c9e-889b-4ece-adce-b38dcfd8dd19 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:33.024324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:33.032055 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b05e4c9e-889b-4ece-adce-b38dcfd8dd19 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:33.032699 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b05e4c9e-889b-4ece-adce-b38dcfd8dd19 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:33.033243 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b05e4c9e-889b-4ece-adce-b38dcfd8dd19 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:33.034210 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b05e4c9e-889b-4ece-adce-b38dcfd8dd19 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:33.034986 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b05e4c9e-889b-4ece-adce-b38dcfd8dd19 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:33.035512 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b05e4c9e-889b-4ece-adce-b38dcfd8dd19 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:33.055990 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-b05e4c9e-889b-4ece-adce-b38dcfd8dd19 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] HTTP exception thrown: Instance 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 could not be found. Aug 31 12:40:33.059334 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b05e4c9e-889b-4ece-adce-b38dcfd8dd19 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Request method failure captured: Aug 31 12:40:33.059334 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 HTTP/1.1 Aug 31 12:40:33.059334 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:40:33.059334 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:40:33.059334 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:40:33.059334 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 0 Aug 31 12:40:33.059334 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:40:33.059334 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:40:33.059334 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:40:33.059334 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:40:33.059334 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1WA4hDI1B8mwzFgw9UjF0bHYxh-W0PYTg_8OeWEX87GiaZzZhuOr6eQtJ_dbJdWxGbnvcJjpQHDWtPVijl1hs_KhQSiluyTrf3Gs1WSceTlpv-MeDVwBqGReHlFVzM62nzVejCXNhnFRVyOFKPna_2ISD5If38YADpegsr8a3mNzBI Aug 31 12:40:33.059334 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:40:33.059334 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:40:33.059334 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:40:33.059334 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:40:33.059334 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:40:33.059334 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:40:33.059334 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: 8f6da846ab4f45a6ac4b2e34bf52abfc Aug 31 12:40:33.059334 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:40:33.059334 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:40:33.059334 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:40:33.062333 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8f6da846ab4f45a6ac4b2e34bf52abfc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:40:33.062333 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:40:33.062333 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: 8f6da846ab4f45a6ac4b2e34bf52abfc Aug 31 12:40:33.062333 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:40:33.062333 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-AttachVolumeNegativeTest-2001270308-project Aug 31 12:40:33.062333 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:40:33.062333 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:40:33.062333 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: d277532df42244c693b5e51e9fd0c459 Aug 31 12:40:33.062333 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-AttachVolumeNegativeTest-2001270308-project Aug 31 12:40:33.062333 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:40:33.062333 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Instance 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 could not be found. Aug 31 12:40:33.062333 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'id': '9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8'} Aug 31 12:40:33.064509 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:40:33.064509 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:33.064509 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:40:33.064509 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:40:33.064509 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:40:33.064509 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:40:33.064509 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:40:33.064509 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:40:33.064509 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:40:33.064509 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:40:33.064509 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 could not be found. Aug 31 12:40:33.064509 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:33.064509 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:40:33.064509 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:33.064509 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:33.064509 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:40:33.064509 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:40:33.064509 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:40:33.064509 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:40:33.064509 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:40:33.066029 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:40:33.066029 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:40:33.066029 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:40:33.066029 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:40:33.066029 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:40:33.066029 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:40:33.066029 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:40:33.066029 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 could not be found. Aug 31 12:40:33.066029 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:33.066029 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:40:33.066029 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:33.066029 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:33.066029 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:40:33.066029 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:40:33.066029 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:40:33.066029 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:40:33.066029 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 could not be found. Aug 31 12:40:33.066029 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:33.067420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b05e4c9e-889b-4ece-adce-b38dcfd8dd19 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Returning 404 to user: Instance 9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 could not be found. {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:40:33.067420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b05e4c9e-889b-4ece-adce-b38dcfd8dd19 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8" status: 404 len: 111 microversion: 2.1 time: 0.052837 Aug 31 12:40:33.067420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 487/985] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:33 2022] GET /compute/v2.1/servers/9e40ede2-5f6c-4d3b-99ef-ca77e43bf8f8 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:40:34.253561 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-28e8cbe8-bfa9-4a10-8d4d-65b1a16ad0f6 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:34.254126 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-28e8cbe8-bfa9-4a10-8d4d-65b1a16ad0f6 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:34.262191 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-28e8cbe8-bfa9-4a10-8d4d-65b1a16ad0f6 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:34.262693 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-28e8cbe8-bfa9-4a10-8d4d-65b1a16ad0f6 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:34.263168 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-28e8cbe8-bfa9-4a10-8d4d-65b1a16ad0f6 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:34.263886 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-28e8cbe8-bfa9-4a10-8d4d-65b1a16ad0f6 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:34.264348 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-28e8cbe8-bfa9-4a10-8d4d-65b1a16ad0f6 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:34.264776 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-28e8cbe8-bfa9-4a10-8d4d-65b1a16ad0f6 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:34.280210 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.wsgi [None req-28e8cbe8-bfa9-4a10-8d4d-65b1a16ad0f6 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] HTTP exception thrown: Instance 0be9b94a-a5f6-4443-862e-e33f7a794c98 could not be found. Aug 31 12:40:34.282443 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-28e8cbe8-bfa9-4a10-8d4d-65b1a16ad0f6 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Request method failure captured: Aug 31 12:40:34.282443 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: request: DELETE /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 HTTP/1.1 Aug 31 12:40:34.282443 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept: application/json Aug 31 12:40:34.282443 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept-Encoding: identity Aug 31 12:40:34.282443 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Connection: close Aug 31 12:40:34.282443 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Length: 0 Aug 31 12:40:34.282443 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Type: application/json Aug 31 12:40:34.282443 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Host: 10.222.0.79 Aug 31 12:40:34.282443 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Openstack-System-Scope: None Aug 31 12:40:34.282443 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: User-Agent: python-urllib3/1.26.12 Aug 31 12:40:34.282443 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Auth-Token: gAAAAABjD1WA4hDI1B8mwzFgw9UjF0bHYxh-W0PYTg_8OeWEX87GiaZzZhuOr6eQtJ_dbJdWxGbnvcJjpQHDWtPVijl1hs_KhQSiluyTrf3Gs1WSceTlpv-MeDVwBqGReHlFVzM62nzVejCXNhnFRVyOFKPna_2ISD5If38YADpegsr8a3mNzBI Aug 31 12:40:34.282443 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Id: None Aug 31 12:40:34.282443 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Name: None Aug 31 12:40:34.282443 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Identity-Status: Confirmed Aug 31 12:40:34.282443 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Is-Admin-Project: True Aug 31 12:40:34.282443 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Id: default Aug 31 12:40:34.282443 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Name: Default Aug 31 12:40:34.282443 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Id: 8f6da846ab4f45a6ac4b2e34bf52abfc Aug 31 12:40:34.282443 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Name: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:40:34.282443 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Role: reader,member Aug 31 12:40:34.282443 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Roles: reader,member Aug 31 12:40:34.284379 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8f6da846ab4f45a6ac4b2e34bf52abfc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:40:34.284379 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:40:34.284379 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Id: 8f6da846ab4f45a6ac4b2e34bf52abfc Aug 31 12:40:34.284379 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:40:34.284379 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User: tempest-AttachVolumeNegativeTest-2001270308-project Aug 31 12:40:34.284379 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Id: default Aug 31 12:40:34.284379 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Name: Default Aug 31 12:40:34.284379 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Id: d277532df42244c693b5e51e9fd0c459 Aug 31 12:40:34.284379 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Name: tempest-AttachVolumeNegativeTest-2001270308-project Aug 31 12:40:34.284379 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: method: > Aug 31 12:40:34.284379 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: exception: Instance 0be9b94a-a5f6-4443-862e-e33f7a794c98 could not be found. Aug 31 12:40:34.284379 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: action_args: {'id': '0be9b94a-a5f6-4443-862e-e33f7a794c98'} Aug 31 12:40:34.285792 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:40:34.285792 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:34.285792 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:40:34.285792 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:40:34.285792 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:40:34.285792 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:40:34.285792 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:40:34.285792 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:40:34.285792 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:40:34.285792 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:40:34.285792 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0be9b94a-a5f6-4443-862e-e33f7a794c98 could not be found. Aug 31 12:40:34.285792 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:34.285792 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:40:34.285792 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:34.285792 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:34.285792 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:40:34.285792 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:40:34.285792 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:40:34.285792 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:40:34.285792 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:40:34.287741 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:40:34.287741 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 12:40:34.287741 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 12:40:34.287741 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 12:40:34.287741 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 12:40:34.287741 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:40:34.287741 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:40:34.287741 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:40:34.287741 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:40:34.287741 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0be9b94a-a5f6-4443-862e-e33f7a794c98 could not be found. Aug 31 12:40:34.287741 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:34.287741 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:40:34.287741 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:34.287741 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:34.287741 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:40:34.287741 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:40:34.287741 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:40:34.287741 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:40:34.287741 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0be9b94a-a5f6-4443-862e-e33f7a794c98 could not be found. Aug 31 12:40:34.287741 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:34.289344 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-28e8cbe8-bfa9-4a10-8d4d-65b1a16ad0f6 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Returning 404 to user: Instance 0be9b94a-a5f6-4443-862e-e33f7a794c98 could not be found. {{(pid=120749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:40:34.289344 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-28e8cbe8-bfa9-4a10-8d4d-65b1a16ad0f6 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 404 len: 111 microversion: 2.1 time: 0.033572 Aug 31 12:40:34.289344 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 499/986] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 31 12:40:34 2022] DELETE /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:40:34.294709 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-31d449fa-d259-4e4b-84f0-9965e447b61a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:34.295357 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-31d449fa-d259-4e4b-84f0-9965e447b61a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: 0be9b94a-a5f6-4443-862e-e33f7a794c98] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:34.302991 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-31d449fa-d259-4e4b-84f0-9965e447b61a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:34.303491 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-31d449fa-d259-4e4b-84f0-9965e447b61a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:34.303924 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-31d449fa-d259-4e4b-84f0-9965e447b61a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:34.304627 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-31d449fa-d259-4e4b-84f0-9965e447b61a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:34.305078 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-31d449fa-d259-4e4b-84f0-9965e447b61a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:34.305700 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-31d449fa-d259-4e4b-84f0-9965e447b61a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:34.320656 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-31d449fa-d259-4e4b-84f0-9965e447b61a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] HTTP exception thrown: Instance 0be9b94a-a5f6-4443-862e-e33f7a794c98 could not be found. Aug 31 12:40:34.322207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-31d449fa-d259-4e4b-84f0-9965e447b61a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Request method failure captured: Aug 31 12:40:34.322207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 HTTP/1.1 Aug 31 12:40:34.322207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:40:34.322207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:40:34.322207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:40:34.322207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 0 Aug 31 12:40:34.322207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:40:34.322207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:40:34.322207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:40:34.322207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:40:34.322207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1WA4hDI1B8mwzFgw9UjF0bHYxh-W0PYTg_8OeWEX87GiaZzZhuOr6eQtJ_dbJdWxGbnvcJjpQHDWtPVijl1hs_KhQSiluyTrf3Gs1WSceTlpv-MeDVwBqGReHlFVzM62nzVejCXNhnFRVyOFKPna_2ISD5If38YADpegsr8a3mNzBI Aug 31 12:40:34.322207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:40:34.322207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:40:34.322207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:40:34.322207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:40:34.322207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:40:34.322207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:40:34.322207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: 8f6da846ab4f45a6ac4b2e34bf52abfc Aug 31 12:40:34.322207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:40:34.322207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:40:34.322207 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:40:34.324674 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8f6da846ab4f45a6ac4b2e34bf52abfc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:40:34.324674 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:40:34.324674 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: 8f6da846ab4f45a6ac4b2e34bf52abfc Aug 31 12:40:34.324674 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:40:34.324674 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-AttachVolumeNegativeTest-2001270308-project Aug 31 12:40:34.324674 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:40:34.324674 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:40:34.324674 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: d277532df42244c693b5e51e9fd0c459 Aug 31 12:40:34.324674 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-AttachVolumeNegativeTest-2001270308-project Aug 31 12:40:34.324674 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:40:34.324674 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Instance 0be9b94a-a5f6-4443-862e-e33f7a794c98 could not be found. Aug 31 12:40:34.324674 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'id': '0be9b94a-a5f6-4443-862e-e33f7a794c98'} Aug 31 12:40:34.325828 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:40:34.325828 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:34.325828 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:40:34.325828 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:40:34.325828 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:40:34.325828 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:40:34.325828 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:40:34.325828 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:40:34.325828 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:40:34.325828 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:40:34.325828 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0be9b94a-a5f6-4443-862e-e33f7a794c98 could not be found. Aug 31 12:40:34.325828 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:34.325828 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:40:34.325828 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:34.325828 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:34.325828 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:40:34.325828 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:40:34.325828 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:40:34.325828 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:40:34.325828 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:40:34.327432 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:40:34.327432 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:40:34.327432 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:40:34.327432 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:40:34.327432 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:40:34.327432 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:40:34.327432 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:40:34.327432 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0be9b94a-a5f6-4443-862e-e33f7a794c98 could not be found. Aug 31 12:40:34.327432 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:34.327432 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:40:34.327432 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:34.327432 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:34.327432 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:40:34.327432 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:40:34.327432 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:40:34.327432 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:40:34.327432 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0be9b94a-a5f6-4443-862e-e33f7a794c98 could not be found. Aug 31 12:40:34.327432 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:34.328850 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-31d449fa-d259-4e4b-84f0-9965e447b61a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Returning 404 to user: Instance 0be9b94a-a5f6-4443-862e-e33f7a794c98 could not be found. {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:40:34.328850 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-31d449fa-d259-4e4b-84f0-9965e447b61a tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98" status: 404 len: 111 microversion: 2.1 time: 0.033458 Aug 31 12:40:34.328850 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 488/987] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:34 2022] GET /compute/v2.1/servers/0be9b94a-a5f6-4443-862e-e33f7a794c98 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:40:34.332881 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-328e3cad-d2b5-407d-83cc-d1ac734e6ccc tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:34.333380 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-328e3cad-d2b5-407d-83cc-d1ac734e6ccc tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d2bf3eb8-923d-4d45-be04-9bbb01430123] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:34.340816 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-328e3cad-d2b5-407d-83cc-d1ac734e6ccc tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:34.341289 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-328e3cad-d2b5-407d-83cc-d1ac734e6ccc tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:34.341734 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-328e3cad-d2b5-407d-83cc-d1ac734e6ccc tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:34.342437 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-328e3cad-d2b5-407d-83cc-d1ac734e6ccc tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:34.342959 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-328e3cad-d2b5-407d-83cc-d1ac734e6ccc tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:34.343389 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-328e3cad-d2b5-407d-83cc-d1ac734e6ccc tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:34.359913 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.wsgi [None req-328e3cad-d2b5-407d-83cc-d1ac734e6ccc tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] HTTP exception thrown: Instance d2bf3eb8-923d-4d45-be04-9bbb01430123 could not be found. Aug 31 12:40:34.361540 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-328e3cad-d2b5-407d-83cc-d1ac734e6ccc tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Request method failure captured: Aug 31 12:40:34.361540 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: request: DELETE /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123 HTTP/1.1 Aug 31 12:40:34.361540 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept: application/json Aug 31 12:40:34.361540 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept-Encoding: identity Aug 31 12:40:34.361540 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Connection: close Aug 31 12:40:34.361540 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Length: 0 Aug 31 12:40:34.361540 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Type: application/json Aug 31 12:40:34.361540 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Host: 10.222.0.79 Aug 31 12:40:34.361540 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Openstack-System-Scope: None Aug 31 12:40:34.361540 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: User-Agent: python-urllib3/1.26.12 Aug 31 12:40:34.361540 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Auth-Token: gAAAAABjD1WA4hDI1B8mwzFgw9UjF0bHYxh-W0PYTg_8OeWEX87GiaZzZhuOr6eQtJ_dbJdWxGbnvcJjpQHDWtPVijl1hs_KhQSiluyTrf3Gs1WSceTlpv-MeDVwBqGReHlFVzM62nzVejCXNhnFRVyOFKPna_2ISD5If38YADpegsr8a3mNzBI Aug 31 12:40:34.361540 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Id: None Aug 31 12:40:34.361540 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Name: None Aug 31 12:40:34.361540 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Identity-Status: Confirmed Aug 31 12:40:34.361540 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Is-Admin-Project: True Aug 31 12:40:34.361540 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Id: default Aug 31 12:40:34.361540 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Name: Default Aug 31 12:40:34.361540 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Id: 8f6da846ab4f45a6ac4b2e34bf52abfc Aug 31 12:40:34.361540 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Name: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:40:34.361540 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Role: reader,member Aug 31 12:40:34.361540 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Roles: reader,member Aug 31 12:40:34.363604 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8f6da846ab4f45a6ac4b2e34bf52abfc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:40:34.363604 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:40:34.363604 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Id: 8f6da846ab4f45a6ac4b2e34bf52abfc Aug 31 12:40:34.363604 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:40:34.363604 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User: tempest-AttachVolumeNegativeTest-2001270308-project Aug 31 12:40:34.363604 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Id: default Aug 31 12:40:34.363604 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Name: Default Aug 31 12:40:34.363604 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Id: d277532df42244c693b5e51e9fd0c459 Aug 31 12:40:34.363604 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Name: tempest-AttachVolumeNegativeTest-2001270308-project Aug 31 12:40:34.363604 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: method: > Aug 31 12:40:34.363604 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: exception: Instance d2bf3eb8-923d-4d45-be04-9bbb01430123 could not be found. Aug 31 12:40:34.363604 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: action_args: {'id': 'd2bf3eb8-923d-4d45-be04-9bbb01430123'} Aug 31 12:40:34.364891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:40:34.364891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:34.364891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:40:34.364891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:40:34.364891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:40:34.364891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:40:34.364891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:40:34.364891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:40:34.364891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:40:34.364891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:40:34.364891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2bf3eb8-923d-4d45-be04-9bbb01430123 could not be found. Aug 31 12:40:34.364891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:34.364891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:40:34.364891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:34.364891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:34.364891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:40:34.364891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:40:34.364891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:40:34.364891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:40:34.364891 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:40:34.367464 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:40:34.367464 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 12:40:34.367464 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 12:40:34.367464 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 12:40:34.367464 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 12:40:34.367464 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:40:34.367464 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:40:34.367464 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:40:34.367464 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:40:34.367464 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2bf3eb8-923d-4d45-be04-9bbb01430123 could not be found. Aug 31 12:40:34.367464 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:34.367464 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:40:34.367464 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:34.367464 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:34.367464 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:40:34.367464 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:40:34.367464 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:40:34.367464 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:40:34.367464 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2bf3eb8-923d-4d45-be04-9bbb01430123 could not be found. Aug 31 12:40:34.367464 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:34.370229 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-328e3cad-d2b5-407d-83cc-d1ac734e6ccc tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Returning 404 to user: Instance d2bf3eb8-923d-4d45-be04-9bbb01430123 could not be found. {{(pid=120749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:40:34.370229 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-328e3cad-d2b5-407d-83cc-d1ac734e6ccc tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123" status: 404 len: 111 microversion: 2.1 time: 0.033951 Aug 31 12:40:34.370229 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 500/988] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 31 12:40:34 2022] DELETE /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:40:34.373301 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-babdd19d-bfb6-44f1-94e7-cf2ed1993abf tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:34.373971 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-babdd19d-bfb6-44f1-94e7-cf2ed1993abf tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d2bf3eb8-923d-4d45-be04-9bbb01430123] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:34.380662 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-babdd19d-bfb6-44f1-94e7-cf2ed1993abf tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:34.381163 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-babdd19d-bfb6-44f1-94e7-cf2ed1993abf tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:34.381598 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-babdd19d-bfb6-44f1-94e7-cf2ed1993abf tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:34.382303 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-babdd19d-bfb6-44f1-94e7-cf2ed1993abf tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:34.382757 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-babdd19d-bfb6-44f1-94e7-cf2ed1993abf tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:34.383212 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-babdd19d-bfb6-44f1-94e7-cf2ed1993abf tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:34.398749 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-babdd19d-bfb6-44f1-94e7-cf2ed1993abf tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] HTTP exception thrown: Instance d2bf3eb8-923d-4d45-be04-9bbb01430123 could not be found. Aug 31 12:40:34.400351 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-babdd19d-bfb6-44f1-94e7-cf2ed1993abf tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Request method failure captured: Aug 31 12:40:34.400351 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123 HTTP/1.1 Aug 31 12:40:34.400351 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:40:34.400351 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:40:34.400351 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:40:34.400351 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 0 Aug 31 12:40:34.400351 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:40:34.400351 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:40:34.400351 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:40:34.400351 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:40:34.400351 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1WA4hDI1B8mwzFgw9UjF0bHYxh-W0PYTg_8OeWEX87GiaZzZhuOr6eQtJ_dbJdWxGbnvcJjpQHDWtPVijl1hs_KhQSiluyTrf3Gs1WSceTlpv-MeDVwBqGReHlFVzM62nzVejCXNhnFRVyOFKPna_2ISD5If38YADpegsr8a3mNzBI Aug 31 12:40:34.400351 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:40:34.400351 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:40:34.400351 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:40:34.400351 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:40:34.400351 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:40:34.400351 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:40:34.400351 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: 8f6da846ab4f45a6ac4b2e34bf52abfc Aug 31 12:40:34.400351 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:40:34.400351 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:40:34.400351 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:40:34.402415 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8f6da846ab4f45a6ac4b2e34bf52abfc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:40:34.402415 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:40:34.402415 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: 8f6da846ab4f45a6ac4b2e34bf52abfc Aug 31 12:40:34.402415 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:40:34.402415 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-AttachVolumeNegativeTest-2001270308-project Aug 31 12:40:34.402415 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:40:34.402415 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:40:34.402415 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: d277532df42244c693b5e51e9fd0c459 Aug 31 12:40:34.402415 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-AttachVolumeNegativeTest-2001270308-project Aug 31 12:40:34.402415 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:40:34.402415 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Instance d2bf3eb8-923d-4d45-be04-9bbb01430123 could not be found. Aug 31 12:40:34.402415 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'id': 'd2bf3eb8-923d-4d45-be04-9bbb01430123'} Aug 31 12:40:34.403290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:40:34.403290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:34.403290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:40:34.403290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:40:34.403290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:40:34.403290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:40:34.403290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:40:34.403290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:40:34.403290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:40:34.403290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:40:34.403290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2bf3eb8-923d-4d45-be04-9bbb01430123 could not be found. Aug 31 12:40:34.403290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:34.403290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:40:34.403290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:34.403290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:34.403290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:40:34.403290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:40:34.403290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:40:34.403290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:40:34.403290 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:40:34.404782 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:40:34.404782 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:40:34.404782 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:40:34.404782 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:40:34.404782 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:40:34.404782 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:40:34.404782 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:40:34.404782 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2bf3eb8-923d-4d45-be04-9bbb01430123 could not be found. Aug 31 12:40:34.404782 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:34.404782 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:40:34.404782 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:34.404782 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:34.404782 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:40:34.404782 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:40:34.404782 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:40:34.404782 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:40:34.404782 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2bf3eb8-923d-4d45-be04-9bbb01430123 could not be found. Aug 31 12:40:34.404782 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:34.407235 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-babdd19d-bfb6-44f1-94e7-cf2ed1993abf tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Returning 404 to user: Instance d2bf3eb8-923d-4d45-be04-9bbb01430123 could not be found. {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:40:34.407235 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-babdd19d-bfb6-44f1-94e7-cf2ed1993abf tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123" status: 404 len: 111 microversion: 2.1 time: 0.034714 Aug 31 12:40:34.407235 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 489/989] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:34 2022] GET /compute/v2.1/servers/d2bf3eb8-923d-4d45-be04-9bbb01430123 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:40:35.576478 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-e05556ee-940e-456b-89a9-321e696d03b2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:35.577054 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-e05556ee-940e-456b-89a9-321e696d03b2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d921f6f0-2017-4941-8d52-1abe875c6ebe] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:35.583312 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e05556ee-940e-456b-89a9-321e696d03b2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:35.583800 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e05556ee-940e-456b-89a9-321e696d03b2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:35.584234 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e05556ee-940e-456b-89a9-321e696d03b2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:35.584938 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e05556ee-940e-456b-89a9-321e696d03b2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:35.585424 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e05556ee-940e-456b-89a9-321e696d03b2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:35.585855 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e05556ee-940e-456b-89a9-321e696d03b2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:35.605323 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.wsgi [None req-e05556ee-940e-456b-89a9-321e696d03b2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] HTTP exception thrown: Instance d921f6f0-2017-4941-8d52-1abe875c6ebe could not be found. Aug 31 12:40:35.608220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-e05556ee-940e-456b-89a9-321e696d03b2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Request method failure captured: Aug 31 12:40:35.608220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: request: DELETE /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe HTTP/1.1 Aug 31 12:40:35.608220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept: application/json Aug 31 12:40:35.608220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept-Encoding: identity Aug 31 12:40:35.608220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Connection: close Aug 31 12:40:35.608220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Length: 0 Aug 31 12:40:35.608220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Type: application/json Aug 31 12:40:35.608220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Host: 10.222.0.79 Aug 31 12:40:35.608220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Openstack-System-Scope: None Aug 31 12:40:35.608220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: User-Agent: python-urllib3/1.26.12 Aug 31 12:40:35.608220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Auth-Token: gAAAAABjD1WA4hDI1B8mwzFgw9UjF0bHYxh-W0PYTg_8OeWEX87GiaZzZhuOr6eQtJ_dbJdWxGbnvcJjpQHDWtPVijl1hs_KhQSiluyTrf3Gs1WSceTlpv-MeDVwBqGReHlFVzM62nzVejCXNhnFRVyOFKPna_2ISD5If38YADpegsr8a3mNzBI Aug 31 12:40:35.608220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Id: None Aug 31 12:40:35.608220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Name: None Aug 31 12:40:35.608220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Identity-Status: Confirmed Aug 31 12:40:35.608220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Is-Admin-Project: True Aug 31 12:40:35.608220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Id: default Aug 31 12:40:35.608220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Name: Default Aug 31 12:40:35.608220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Id: 8f6da846ab4f45a6ac4b2e34bf52abfc Aug 31 12:40:35.608220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Name: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:40:35.608220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Role: reader,member Aug 31 12:40:35.608220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Roles: reader,member Aug 31 12:40:35.610007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8f6da846ab4f45a6ac4b2e34bf52abfc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:40:35.610007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:40:35.610007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Id: 8f6da846ab4f45a6ac4b2e34bf52abfc Aug 31 12:40:35.610007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:40:35.610007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User: tempest-AttachVolumeNegativeTest-2001270308-project Aug 31 12:40:35.610007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Id: default Aug 31 12:40:35.610007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Name: Default Aug 31 12:40:35.610007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Id: d277532df42244c693b5e51e9fd0c459 Aug 31 12:40:35.610007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Name: tempest-AttachVolumeNegativeTest-2001270308-project Aug 31 12:40:35.610007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: method: > Aug 31 12:40:35.610007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: exception: Instance d921f6f0-2017-4941-8d52-1abe875c6ebe could not be found. Aug 31 12:40:35.610007 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: action_args: {'id': 'd921f6f0-2017-4941-8d52-1abe875c6ebe'} Aug 31 12:40:35.611029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:40:35.611029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:35.611029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:40:35.611029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:40:35.611029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:40:35.611029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:40:35.611029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:40:35.611029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:40:35.611029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:40:35.611029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:40:35.611029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d921f6f0-2017-4941-8d52-1abe875c6ebe could not be found. Aug 31 12:40:35.611029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:35.611029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:40:35.611029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:35.611029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:35.611029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:40:35.611029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:40:35.611029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:40:35.611029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:40:35.611029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:40:35.612626 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:40:35.612626 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 12:40:35.612626 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 12:40:35.612626 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 12:40:35.612626 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 12:40:35.612626 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:40:35.612626 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:40:35.612626 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:40:35.612626 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:40:35.612626 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d921f6f0-2017-4941-8d52-1abe875c6ebe could not be found. Aug 31 12:40:35.612626 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:35.612626 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:40:35.612626 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:35.612626 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:35.612626 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:40:35.612626 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:40:35.612626 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:40:35.612626 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:40:35.612626 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d921f6f0-2017-4941-8d52-1abe875c6ebe could not be found. Aug 31 12:40:35.612626 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:40:35.614801 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-e05556ee-940e-456b-89a9-321e696d03b2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Returning 404 to user: Instance d921f6f0-2017-4941-8d52-1abe875c6ebe could not be found. {{(pid=120749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:40:35.614801 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-e05556ee-940e-456b-89a9-321e696d03b2 tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe" status: 404 len: 111 microversion: 2.1 time: 0.037725 Aug 31 12:40:35.614801 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 501/990] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 31 12:40:35 2022] DELETE /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:40:35.618555 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-508c1a42-1f92-405b-9feb-136b17ec92fa tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:35.619538 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-508c1a42-1f92-405b-9feb-136b17ec92fa tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] [instance: d921f6f0-2017-4941-8d52-1abe875c6ebe] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:35.626263 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-508c1a42-1f92-405b-9feb-136b17ec92fa tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:35.626745 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-508c1a42-1f92-405b-9feb-136b17ec92fa tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:35.627227 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-508c1a42-1f92-405b-9feb-136b17ec92fa tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:35.627907 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-508c1a42-1f92-405b-9feb-136b17ec92fa tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:35.628352 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-508c1a42-1f92-405b-9feb-136b17ec92fa tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:35.628765 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-508c1a42-1f92-405b-9feb-136b17ec92fa tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:35.644820 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-508c1a42-1f92-405b-9feb-136b17ec92fa tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] HTTP exception thrown: Instance d921f6f0-2017-4941-8d52-1abe875c6ebe could not be found. Aug 31 12:40:35.646346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-508c1a42-1f92-405b-9feb-136b17ec92fa tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Request method failure captured: Aug 31 12:40:35.646346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe HTTP/1.1 Aug 31 12:40:35.646346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:40:35.646346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:40:35.646346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:40:35.646346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 0 Aug 31 12:40:35.646346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:40:35.646346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:40:35.646346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:40:35.646346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:40:35.646346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1WA4hDI1B8mwzFgw9UjF0bHYxh-W0PYTg_8OeWEX87GiaZzZhuOr6eQtJ_dbJdWxGbnvcJjpQHDWtPVijl1hs_KhQSiluyTrf3Gs1WSceTlpv-MeDVwBqGReHlFVzM62nzVejCXNhnFRVyOFKPna_2ISD5If38YADpegsr8a3mNzBI Aug 31 12:40:35.646346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:40:35.646346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:40:35.646346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:40:35.646346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:40:35.646346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:40:35.646346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:40:35.646346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: 8f6da846ab4f45a6ac4b2e34bf52abfc Aug 31 12:40:35.646346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:40:35.646346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:40:35.646346 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:40:35.648181 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8f6da846ab4f45a6ac4b2e34bf52abfc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f6da846ab4f45a6ac4b2e34bf52abfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:40:35.648181 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:40:35.648181 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: 8f6da846ab4f45a6ac4b2e34bf52abfc Aug 31 12:40:35.648181 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2001270308 Aug 31 12:40:35.648181 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-AttachVolumeNegativeTest-2001270308-project Aug 31 12:40:35.648181 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:40:35.648181 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:40:35.648181 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: d277532df42244c693b5e51e9fd0c459 Aug 31 12:40:35.648181 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-AttachVolumeNegativeTest-2001270308-project Aug 31 12:40:35.648181 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:40:35.648181 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Instance d921f6f0-2017-4941-8d52-1abe875c6ebe could not be found. Aug 31 12:40:35.648181 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'id': 'd921f6f0-2017-4941-8d52-1abe875c6ebe'} Aug 31 12:40:35.649246 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:40:35.649246 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:35.649246 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:40:35.649246 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:40:35.649246 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:40:35.649246 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:40:35.649246 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:40:35.649246 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:40:35.649246 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:40:35.649246 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:40:35.649246 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d921f6f0-2017-4941-8d52-1abe875c6ebe could not be found. Aug 31 12:40:35.649246 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:35.649246 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:40:35.649246 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:35.649246 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:35.649246 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:40:35.649246 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:40:35.649246 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:40:35.649246 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:40:35.649246 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:40:35.651404 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:40:35.651404 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:40:35.651404 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:40:35.651404 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:40:35.651404 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:40:35.651404 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:40:35.651404 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:40:35.651404 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d921f6f0-2017-4941-8d52-1abe875c6ebe could not be found. Aug 31 12:40:35.651404 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:35.651404 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:40:35.651404 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:35.651404 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:40:35.651404 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:40:35.651404 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:40:35.651404 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:40:35.651404 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:40:35.651404 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d921f6f0-2017-4941-8d52-1abe875c6ebe could not be found. Aug 31 12:40:35.651404 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:40:35.652978 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-508c1a42-1f92-405b-9feb-136b17ec92fa tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] Returning 404 to user: Instance d921f6f0-2017-4941-8d52-1abe875c6ebe could not be found. {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:40:35.652978 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-508c1a42-1f92-405b-9feb-136b17ec92fa tempest-AttachVolumeNegativeTest-2001270308 tempest-AttachVolumeNegativeTest-2001270308-project] 10.222.0.79 "GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe" status: 404 len: 111 microversion: 2.1 time: 0.033079 Aug 31 12:40:35.652978 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 490/991] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:35 2022] GET /compute/v2.1/servers/d921f6f0-2017-4941-8d52-1abe875c6ebe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:41:22.017282 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-7595dafc-cdb8-468b-bebc-b00d503c3152 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Action: 'create', calling method: .version_select at 0x7f8d1738f040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2059934916", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcpWn4F8uqnU2wxIJ5cezzho/k03YRCvcMjGbJmXPFi1LePpiG8XL8b+1ijrDxRY7tvZ5oaW1vchH9oQG8N+SzkDcpzH3BNvb0dVbqWXweS7YpgxBGTB5vKl82fjQDYyA=="}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:41:22.023330 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_api:SELECT=7 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:22.023987 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=24 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:22.036579 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-7595dafc-cdb8-468b-bebc-b00d503c3152 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Getting quotas for project e8ba32b297b84802941b32e82f3a67e5. Resources: {'key_pairs'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:41:22.040405 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.quota [None req-7595dafc-cdb8-468b-bebc-b00d503c3152 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Getting quotas for user 463ffd63f6d54b629e160c3476eae261 and project e8ba32b297b84802941b32e82f3a67e5. Resources: {'key_pairs'} {{(pid=120749) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:41:22.063219 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-7595dafc-cdb8-468b-bebc-b00d503c3152 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.050204 Aug 31 12:41:22.063816 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 502/992] 10.222.0.79 () {60 vars in 1159 bytes} [Wed Aug 31 12:41:22 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:41:22.114399 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-eeddbb50-c957-46dd-a554-db85cc99a247 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-551673613", "imageRef": "2412f12c-4eb9-4c41-95d7-f19ce0292048", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2059934916", "networks": [{"uuid": "4597fc61-60a8-40fe-b10b-c1e61333e5e9"}]}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:41:22.124738 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_api:SELECT=7 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:22.125393 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:22.171749 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.network.neutron [None req-eeddbb50-c957-46dd-a554-db85cc99a247 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] validate_networks() for [('4597fc61-60a8-40fe-b10b-c1e61333e5e9', None, None, None, None, None)] {{(pid=120750) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:41:22.540932 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-eeddbb50-c957-46dd-a554-db85cc99a247 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Flavor limits 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:41:22.541353 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-eeddbb50-c957-46dd-a554-db85cc99a247 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Image limits 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:41:22.541821 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-eeddbb50-c957-46dd-a554-db85cc99a247 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Flavor pref 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:41:22.542227 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-eeddbb50-c957-46dd-a554-db85cc99a247 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Image pref 0:0:0 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:41:22.542635 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.virt.hardware [None req-eeddbb50-c957-46dd-a554-db85cc99a247 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:41:22.552686 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-eeddbb50-c957-46dd-a554-db85cc99a247 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:22.553170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-eeddbb50-c957-46dd-a554-db85cc99a247 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:22.553603 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-eeddbb50-c957-46dd-a554-db85cc99a247 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:22.554330 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-eeddbb50-c957-46dd-a554-db85cc99a247 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:22.554785 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-eeddbb50-c957-46dd-a554-db85cc99a247 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:22.555233 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-eeddbb50-c957-46dd-a554-db85cc99a247 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:22.571869 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-eeddbb50-c957-46dd-a554-db85cc99a247 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Getting quotas for project e8ba32b297b84802941b32e82f3a67e5. Resources: {'cores', 'ram', 'instances'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:41:22.576240 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.quota [None req-eeddbb50-c957-46dd-a554-db85cc99a247 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Getting quotas for user 463ffd63f6d54b629e160c3476eae261 and project e8ba32b297b84802941b32e82f3a67e5. Resources: {'cores', 'ram', 'instances'} {{(pid=120750) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:41:22.587403 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-eeddbb50-c957-46dd-a554-db85cc99a247 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Going to run 1 instances... {{(pid=120750) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:41:22.590297 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-eeddbb50-c957-46dd-a554-db85cc99a247 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2412f12c-4eb9-4c41-95d7-f19ce0292048',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120750) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:41:22.635258 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-eeddbb50-c957-46dd-a554-db85cc99a247 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524725 Aug 31 12:41:22.635891 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 491/993] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 31 12:41:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 12:41:22.646563 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-eb4ab89a-3af5-49dc-97a4-375c33c0873b tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:22.647196 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-eb4ab89a-3af5-49dc-97a4-375c33c0873b tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:22.701671 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-eb4ab89a-3af5-49dc-97a4-375c33c0873b tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:22.709483 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-eb4ab89a-3af5-49dc-97a4-375c33c0873b tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1258 microversion: 2.1 time: 0.066808 Aug 31 12:41:22.710046 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 503/994] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:22 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:23.731372 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-b690a55b-40c4-48e4-92f4-04802b5736f6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:23.732165 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-b690a55b-40c4-48e4-92f4-04802b5736f6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:23.739180 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b690a55b-40c4-48e4-92f4-04802b5736f6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:23.739657 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b690a55b-40c4-48e4-92f4-04802b5736f6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:23.740289 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b690a55b-40c4-48e4-92f4-04802b5736f6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:23.741273 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b690a55b-40c4-48e4-92f4-04802b5736f6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:23.741894 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b690a55b-40c4-48e4-92f4-04802b5736f6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:23.742611 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-b690a55b-40c4-48e4-92f4-04802b5736f6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:23.832249 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-b690a55b-40c4-48e4-92f4-04802b5736f6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:23.842950 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-b690a55b-40c4-48e4-92f4-04802b5736f6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1318 microversion: 2.1 time: 0.116270 Aug 31 12:41:23.843772 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 492/995] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:23 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1318 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:24.865530 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-4d65e4bc-e84d-48e5-a9fe-16e277a9862f tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:24.866125 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-4d65e4bc-e84d-48e5-a9fe-16e277a9862f tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:24.873594 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4d65e4bc-e84d-48e5-a9fe-16e277a9862f tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:24.874197 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4d65e4bc-e84d-48e5-a9fe-16e277a9862f tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:24.874710 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4d65e4bc-e84d-48e5-a9fe-16e277a9862f tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:24.875507 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4d65e4bc-e84d-48e5-a9fe-16e277a9862f tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:24.876226 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4d65e4bc-e84d-48e5-a9fe-16e277a9862f tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:24.876789 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4d65e4bc-e84d-48e5-a9fe-16e277a9862f tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:25.049904 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-4d65e4bc-e84d-48e5-a9fe-16e277a9862f tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:25.058078 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-4d65e4bc-e84d-48e5-a9fe-16e277a9862f tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1358 microversion: 2.1 time: 0.196753 Aug 31 12:41:25.059137 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 504/996] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:24 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:26.080430 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-44c494a4-d1ed-4a3e-8455-20216ccae571 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:26.081388 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-44c494a4-d1ed-4a3e-8455-20216ccae571 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:26.089399 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-44c494a4-d1ed-4a3e-8455-20216ccae571 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:26.090698 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-44c494a4-d1ed-4a3e-8455-20216ccae571 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:26.091167 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-44c494a4-d1ed-4a3e-8455-20216ccae571 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:26.091975 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-44c494a4-d1ed-4a3e-8455-20216ccae571 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:26.092430 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-44c494a4-d1ed-4a3e-8455-20216ccae571 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:26.092851 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-44c494a4-d1ed-4a3e-8455-20216ccae571 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:26.245548 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-44c494a4-d1ed-4a3e-8455-20216ccae571 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:26.254078 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-44c494a4-d1ed-4a3e-8455-20216ccae571 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1358 microversion: 2.1 time: 0.177509 Aug 31 12:41:26.254660 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 493/997] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:26 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:27.281204 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-f29c4e9b-f396-4169-b19f-3ad2a70838dc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:27.282015 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-f29c4e9b-f396-4169-b19f-3ad2a70838dc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:27.289465 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f29c4e9b-f396-4169-b19f-3ad2a70838dc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:27.289957 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f29c4e9b-f396-4169-b19f-3ad2a70838dc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:27.290389 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f29c4e9b-f396-4169-b19f-3ad2a70838dc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:27.291140 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f29c4e9b-f396-4169-b19f-3ad2a70838dc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:27.291597 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f29c4e9b-f396-4169-b19f-3ad2a70838dc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:27.292017 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f29c4e9b-f396-4169-b19f-3ad2a70838dc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:27.510995 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-f29c4e9b-f396-4169-b19f-3ad2a70838dc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:27.518970 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-f29c4e9b-f396-4169-b19f-3ad2a70838dc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1358 microversion: 2.1 time: 0.243030 Aug 31 12:41:27.519682 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 505/998] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:27 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:28.547490 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-f67e19d9-6690-435f-aff7-886882f7d3c4 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:28.548136 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-f67e19d9-6690-435f-aff7-886882f7d3c4 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:28.554837 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f67e19d9-6690-435f-aff7-886882f7d3c4 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:28.555341 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f67e19d9-6690-435f-aff7-886882f7d3c4 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:28.556201 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f67e19d9-6690-435f-aff7-886882f7d3c4 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:28.556437 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f67e19d9-6690-435f-aff7-886882f7d3c4 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:28.556879 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f67e19d9-6690-435f-aff7-886882f7d3c4 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:28.557390 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f67e19d9-6690-435f-aff7-886882f7d3c4 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:28.705372 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f67e19d9-6690-435f-aff7-886882f7d3c4 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:28.715400 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-f67e19d9-6690-435f-aff7-886882f7d3c4 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1358 microversion: 2.1 time: 0.171981 Aug 31 12:41:28.715996 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 494/999] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:28 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:29.739965 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-854b001d-55df-405e-8e97-df92f758f685 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:29.740694 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-854b001d-55df-405e-8e97-df92f758f685 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:29.747509 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-854b001d-55df-405e-8e97-df92f758f685 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:29.748003 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-854b001d-55df-405e-8e97-df92f758f685 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:29.748496 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-854b001d-55df-405e-8e97-df92f758f685 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:29.749139 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-854b001d-55df-405e-8e97-df92f758f685 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:29.749586 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-854b001d-55df-405e-8e97-df92f758f685 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:29.750117 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-854b001d-55df-405e-8e97-df92f758f685 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:29.906907 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-854b001d-55df-405e-8e97-df92f758f685 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:29.910322 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-854b001d-55df-405e-8e97-df92f758f685 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1358 microversion: 2.1 time: 0.176387 Aug 31 12:41:29.910915 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 506/1000] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:29 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:30.931430 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-715c7e9b-b093-474b-8fc3-6b8f08827e05 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:30.932760 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-715c7e9b-b093-474b-8fc3-6b8f08827e05 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:30.960541 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-715c7e9b-b093-474b-8fc3-6b8f08827e05 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:30.961892 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-715c7e9b-b093-474b-8fc3-6b8f08827e05 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:30.962432 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-715c7e9b-b093-474b-8fc3-6b8f08827e05 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:30.964467 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-715c7e9b-b093-474b-8fc3-6b8f08827e05 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:30.966697 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-715c7e9b-b093-474b-8fc3-6b8f08827e05 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:30.967523 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-715c7e9b-b093-474b-8fc3-6b8f08827e05 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:31.113056 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-715c7e9b-b093-474b-8fc3-6b8f08827e05 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:31.122324 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-715c7e9b-b093-474b-8fc3-6b8f08827e05 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1358 microversion: 2.1 time: 0.194756 Aug 31 12:41:31.123653 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 495/1001] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:30 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:32.143650 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-aeaa5110-51ee-41de-91c4-a38e8c5bb930 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:32.144573 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-aeaa5110-51ee-41de-91c4-a38e8c5bb930 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:32.152983 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-aeaa5110-51ee-41de-91c4-a38e8c5bb930 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:32.153509 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-aeaa5110-51ee-41de-91c4-a38e8c5bb930 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:32.153949 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-aeaa5110-51ee-41de-91c4-a38e8c5bb930 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:32.154676 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-aeaa5110-51ee-41de-91c4-a38e8c5bb930 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:32.155170 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-aeaa5110-51ee-41de-91c4-a38e8c5bb930 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:32.155598 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-aeaa5110-51ee-41de-91c4-a38e8c5bb930 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:32.298516 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-aeaa5110-51ee-41de-91c4-a38e8c5bb930 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:32.306765 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-aeaa5110-51ee-41de-91c4-a38e8c5bb930 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1358 microversion: 2.1 time: 0.167861 Aug 31 12:41:32.307383 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 507/1002] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:32 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:32.780384 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-41729d8d-5f84-435c-a6c1-a748c59c7f35 req-ee0c0c02-82a1-4ef6-a018-caaf318980f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4498593-a0a3-4d64-a784-cb171ef2ed36", "tag": "053f2a29-0f5c-4365-8bc1-9f22a94101d9"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:41:32.786560 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell0:SELECT=2 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:32.787482 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell0:SELECT=6 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:32.806369 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-41729d8d-5f84-435c-a6c1-a748c59c7f35 req-ee0c0c02-82a1-4ef6-a018-caaf318980f2 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:32.806886 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-41729d8d-5f84-435c-a6c1-a748c59c7f35 req-ee0c0c02-82a1-4ef6-a018-caaf318980f2 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:32.807331 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-41729d8d-5f84-435c-a6c1-a748c59c7f35 req-ee0c0c02-82a1-4ef6-a018-caaf318980f2 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:32.821433 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-41729d8d-5f84-435c-a6c1-a748c59c7f35 req-ee0c0c02-82a1-4ef6-a018-caaf318980f2 service nova] Creating event network-changed:053f2a29-0f5c-4365-8bc1-9f22a94101d9 for instance e4498593-a0a3-4d64-a784-cb171ef2ed36 on hv-cinder-85528 Aug 31 12:41:32.827572 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-41729d8d-5f84-435c-a6c1-a748c59c7f35 req-ee0c0c02-82a1-4ef6-a018-caaf318980f2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052381 Aug 31 12:41:32.828496 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 496/1003] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:41:33.330194 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-188e15c3-8068-4689-8b36-eff51857ffb2 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:33.330875 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-188e15c3-8068-4689-8b36-eff51857ffb2 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:33.332684 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=6 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:33.339111 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-188e15c3-8068-4689-8b36-eff51857ffb2 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:33.339744 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-188e15c3-8068-4689-8b36-eff51857ffb2 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:33.340185 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-188e15c3-8068-4689-8b36-eff51857ffb2 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:33.340898 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-188e15c3-8068-4689-8b36-eff51857ffb2 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:33.341541 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-188e15c3-8068-4689-8b36-eff51857ffb2 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:33.341981 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-188e15c3-8068-4689-8b36-eff51857ffb2 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:33.489291 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-188e15c3-8068-4689-8b36-eff51857ffb2 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:33.498949 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-188e15c3-8068-4689-8b36-eff51857ffb2 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1358 microversion: 2.1 time: 0.172563 Aug 31 12:41:33.499535 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 508/1004] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:33 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:34.522698 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-03b4137c-7f26-46ba-9303-cf1228e0cf66 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:34.524284 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-03b4137c-7f26-46ba-9303-cf1228e0cf66 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:34.532965 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-03b4137c-7f26-46ba-9303-cf1228e0cf66 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:34.533747 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-03b4137c-7f26-46ba-9303-cf1228e0cf66 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:34.534372 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-03b4137c-7f26-46ba-9303-cf1228e0cf66 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:34.535163 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-03b4137c-7f26-46ba-9303-cf1228e0cf66 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:34.535619 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-03b4137c-7f26-46ba-9303-cf1228e0cf66 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:34.536036 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-03b4137c-7f26-46ba-9303-cf1228e0cf66 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:34.754734 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-03b4137c-7f26-46ba-9303-cf1228e0cf66 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:34.763763 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-03b4137c-7f26-46ba-9303-cf1228e0cf66 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1358 microversion: 2.1 time: 0.247056 Aug 31 12:41:34.764700 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 497/1005] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:34 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:35.786085 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-f30123b0-7822-4afc-a1ff-1dfd7ed0ea89 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:35.786713 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-f30123b0-7822-4afc-a1ff-1dfd7ed0ea89 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:35.793704 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f30123b0-7822-4afc-a1ff-1dfd7ed0ea89 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:35.794140 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f30123b0-7822-4afc-a1ff-1dfd7ed0ea89 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:35.794579 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f30123b0-7822-4afc-a1ff-1dfd7ed0ea89 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:35.795317 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f30123b0-7822-4afc-a1ff-1dfd7ed0ea89 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:35.795785 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f30123b0-7822-4afc-a1ff-1dfd7ed0ea89 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:35.796214 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f30123b0-7822-4afc-a1ff-1dfd7ed0ea89 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:35.932679 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-f30123b0-7822-4afc-a1ff-1dfd7ed0ea89 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:35.941208 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-f30123b0-7822-4afc-a1ff-1dfd7ed0ea89 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1358 microversion: 2.1 time: 0.159064 Aug 31 12:41:35.941786 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 509/1006] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:35 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:36.588606 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-66e656eb-2e37-4a10-8d6d-9182e88bc3a6 req-12584780-336f-4551-9063-7dba96706cdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4498593-a0a3-4d64-a784-cb171ef2ed36", "name": "network-vif-plugged", "status": "completed", "tag": "053f2a29-0f5c-4365-8bc1-9f22a94101d9"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:41:36.598385 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-66e656eb-2e37-4a10-8d6d-9182e88bc3a6 req-12584780-336f-4551-9063-7dba96706cdd service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:36.598879 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-66e656eb-2e37-4a10-8d6d-9182e88bc3a6 req-12584780-336f-4551-9063-7dba96706cdd service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:36.599312 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-66e656eb-2e37-4a10-8d6d-9182e88bc3a6 req-12584780-336f-4551-9063-7dba96706cdd service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:36.612114 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-66e656eb-2e37-4a10-8d6d-9182e88bc3a6 req-12584780-336f-4551-9063-7dba96706cdd service nova] Creating event network-vif-plugged:053f2a29-0f5c-4365-8bc1-9f22a94101d9 for instance e4498593-a0a3-4d64-a784-cb171ef2ed36 on hv-cinder-85528 Aug 31 12:41:36.617249 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-66e656eb-2e37-4a10-8d6d-9182e88bc3a6 req-12584780-336f-4551-9063-7dba96706cdd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176141 Aug 31 12:41:36.617864 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 498/1007] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:41:36.962729 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-10d67d20-6cc6-4739-9a9f-b614f8c262f8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:36.963379 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-10d67d20-6cc6-4739-9a9f-b614f8c262f8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:36.970951 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-10d67d20-6cc6-4739-9a9f-b614f8c262f8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:36.971498 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-10d67d20-6cc6-4739-9a9f-b614f8c262f8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:36.971949 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-10d67d20-6cc6-4739-9a9f-b614f8c262f8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:36.972680 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-10d67d20-6cc6-4739-9a9f-b614f8c262f8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:36.973149 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-10d67d20-6cc6-4739-9a9f-b614f8c262f8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:36.973580 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-10d67d20-6cc6-4739-9a9f-b614f8c262f8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:37.114761 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-10d67d20-6cc6-4739-9a9f-b614f8c262f8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:37.123900 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-10d67d20-6cc6-4739-9a9f-b614f8c262f8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1358 microversion: 2.1 time: 0.165082 Aug 31 12:41:37.124483 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 510/1008] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:36 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:38.144771 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-d672fa95-8904-4f35-b9c9-d7d3adb92bfc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:38.145482 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-d672fa95-8904-4f35-b9c9-d7d3adb92bfc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:38.151693 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d672fa95-8904-4f35-b9c9-d7d3adb92bfc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:38.152764 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d672fa95-8904-4f35-b9c9-d7d3adb92bfc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:38.153253 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d672fa95-8904-4f35-b9c9-d7d3adb92bfc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:38.153977 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d672fa95-8904-4f35-b9c9-d7d3adb92bfc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:38.154427 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d672fa95-8904-4f35-b9c9-d7d3adb92bfc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:38.154843 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d672fa95-8904-4f35-b9c9-d7d3adb92bfc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:38.304787 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-d672fa95-8904-4f35-b9c9-d7d3adb92bfc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:38.313427 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-d672fa95-8904-4f35-b9c9-d7d3adb92bfc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1358 microversion: 2.1 time: 0.173184 Aug 31 12:41:38.314013 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 499/1009] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:38 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:39.335138 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-95aef904-fddc-454f-871c-36c514bc3edc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:39.335760 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-95aef904-fddc-454f-871c-36c514bc3edc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:39.344141 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-95aef904-fddc-454f-871c-36c514bc3edc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:39.344638 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-95aef904-fddc-454f-871c-36c514bc3edc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:39.345074 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-95aef904-fddc-454f-871c-36c514bc3edc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:39.345772 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-95aef904-fddc-454f-871c-36c514bc3edc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:39.346219 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-95aef904-fddc-454f-871c-36c514bc3edc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:39.346634 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-95aef904-fddc-454f-871c-36c514bc3edc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:39.490269 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-95aef904-fddc-454f-871c-36c514bc3edc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:39.499108 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-95aef904-fddc-454f-871c-36c514bc3edc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1549 microversion: 2.1 time: 0.167793 Aug 31 12:41:39.499687 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 511/1010] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:39 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1549 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:39.519668 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-4439dc5c-5ddd-45fe-8a4e-216e90cb9124 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:39.520354 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-4439dc5c-5ddd-45fe-8a4e-216e90cb9124 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:39.526877 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4439dc5c-5ddd-45fe-8a4e-216e90cb9124 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:39.527366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4439dc5c-5ddd-45fe-8a4e-216e90cb9124 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:39.527797 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4439dc5c-5ddd-45fe-8a4e-216e90cb9124 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:39.528488 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4439dc5c-5ddd-45fe-8a4e-216e90cb9124 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:39.528933 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4439dc5c-5ddd-45fe-8a4e-216e90cb9124 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:39.529349 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4439dc5c-5ddd-45fe-8a4e-216e90cb9124 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:39.664106 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-4439dc5c-5ddd-45fe-8a4e-216e90cb9124 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:39.673015 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-4439dc5c-5ddd-45fe-8a4e-216e90cb9124 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1549 microversion: 2.1 time: 0.157137 Aug 31 12:41:39.673591 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 500/1011] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:39 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:39.693482 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-a59670eb-cc2b-4c07-b89c-8076d91f5ea8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:39.698553 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-a59670eb-cc2b-4c07-b89c-8076d91f5ea8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:39.699589 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-a59670eb-cc2b-4c07-b89c-8076d91f5ea8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Searching by: {'deleted': False, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5'} {{(pid=120749) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 12:41:39.706662 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a59670eb-cc2b-4c07-b89c-8076d91f5ea8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:39.707182 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a59670eb-cc2b-4c07-b89c-8076d91f5ea8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:39.707670 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a59670eb-cc2b-4c07-b89c-8076d91f5ea8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:39.708398 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a59670eb-cc2b-4c07-b89c-8076d91f5ea8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:39.708850 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a59670eb-cc2b-4c07-b89c-8076d91f5ea8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:39.709268 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a59670eb-cc2b-4c07-b89c-8076d91f5ea8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:39.804675 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.multi_cell_list [None req-a59670eb-cc2b-4c07-b89c-8076d91f5ea8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120749) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 12:41:39.903426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-a59670eb-cc2b-4c07-b89c-8076d91f5ea8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.213415 Aug 31 12:41:39.903935 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 512/1012] 10.222.0.79 () {58 vars in 1125 bytes} [Wed Aug 31 12:41:39 2022] GET /compute/v2.1/servers => generated 342 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:41:39.915465 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-c61082b0-5de4-4da0-af39-8b16278397ff tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:39.916076 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-c61082b0-5de4-4da0-af39-8b16278397ff tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:39.922283 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c61082b0-5de4-4da0-af39-8b16278397ff tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:39.922767 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c61082b0-5de4-4da0-af39-8b16278397ff tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:39.923242 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c61082b0-5de4-4da0-af39-8b16278397ff tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:39.923964 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c61082b0-5de4-4da0-af39-8b16278397ff tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:39.924413 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c61082b0-5de4-4da0-af39-8b16278397ff tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:39.924837 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-c61082b0-5de4-4da0-af39-8b16278397ff tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:40.058088 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-c61082b0-5de4-4da0-af39-8b16278397ff tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:40.067011 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-c61082b0-5de4-4da0-af39-8b16278397ff tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1549 microversion: 2.1 time: 0.155294 Aug 31 12:41:40.067602 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 501/1013] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:39 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:41:41.770777 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-fa03dc5b-f6e3-446a-acd5-65805210b754 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9d96859-e1dd-4cbd-82e1-ce103d691795"}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:41:41.773235 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-fa03dc5b-f6e3-446a-acd5-65805210b754 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:41.780948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fa03dc5b-f6e3-446a-acd5-65805210b754 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:41.781440 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fa03dc5b-f6e3-446a-acd5-65805210b754 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:41.781877 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fa03dc5b-f6e3-446a-acd5-65805210b754 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:41.782593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fa03dc5b-f6e3-446a-acd5-65805210b754 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:41.783087 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fa03dc5b-f6e3-446a-acd5-65805210b754 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:41.783515 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-fa03dc5b-f6e3-446a-acd5-65805210b754 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:42.049242 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-fa03dc5b-f6e3-446a-acd5-65805210b754 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "POST /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282330 Aug 31 12:41:42.049847 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 513/1014] 10.222.0.79 () {60 vars in 1323 bytes} [Wed Aug 31 12:41:41 2022] POST /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:41:48.596860 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-d349f629-6077-4410-8067-f24a43010386 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:48.597466 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-d349f629-6077-4410-8067-f24a43010386 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:48.604313 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d349f629-6077-4410-8067-f24a43010386 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:48.604793 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d349f629-6077-4410-8067-f24a43010386 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:48.605228 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d349f629-6077-4410-8067-f24a43010386 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:48.605920 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d349f629-6077-4410-8067-f24a43010386 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:48.606955 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d349f629-6077-4410-8067-f24a43010386 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:48.607489 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-d349f629-6077-4410-8067-f24a43010386 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:48.755876 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-d349f629-6077-4410-8067-f24a43010386 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:48.764853 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-d349f629-6077-4410-8067-f24a43010386 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1595 microversion: 2.1 time: 0.171731 Aug 31 12:41:48.765427 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 502/1015] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:48 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1595 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:50.467304 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell0:SELECT=2 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:50.473824 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-15892555-72d5-44dd-b8ed-28801d593d2f req-33a66c8d-da64-4ec6-bd0b-137eae554f90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4498593-a0a3-4d64-a784-cb171ef2ed36", "tag": "053f2a29-0f5c-4365-8bc1-9f22a94101d9"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:41:50.485321 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-15892555-72d5-44dd-b8ed-28801d593d2f req-33a66c8d-da64-4ec6-bd0b-137eae554f90 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:50.486102 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-15892555-72d5-44dd-b8ed-28801d593d2f req-33a66c8d-da64-4ec6-bd0b-137eae554f90 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:50.486551 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-15892555-72d5-44dd-b8ed-28801d593d2f req-33a66c8d-da64-4ec6-bd0b-137eae554f90 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:50.501115 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-15892555-72d5-44dd-b8ed-28801d593d2f req-33a66c8d-da64-4ec6-bd0b-137eae554f90 service nova] Creating event network-changed:053f2a29-0f5c-4365-8bc1-9f22a94101d9 for instance e4498593-a0a3-4d64-a784-cb171ef2ed36 on hv-cinder-85528 Aug 31 12:41:50.506782 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-15892555-72d5-44dd-b8ed-28801d593d2f req-33a66c8d-da64-4ec6-bd0b-137eae554f90 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040805 Aug 31 12:41:50.507834 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 514/1016] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:41:51.564067 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-f3bbd301-cdbb-4315-978b-180b49d44bbf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-899398892"}} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:41:51.564953 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-f3bbd301-cdbb-4315-978b-180b49d44bbf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:51.570793 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f3bbd301-cdbb-4315-978b-180b49d44bbf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:51.571307 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f3bbd301-cdbb-4315-978b-180b49d44bbf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:51.571738 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f3bbd301-cdbb-4315-978b-180b49d44bbf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:51.572430 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f3bbd301-cdbb-4315-978b-180b49d44bbf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:51.572879 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f3bbd301-cdbb-4315-978b-180b49d44bbf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:51.573295 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f3bbd301-cdbb-4315-978b-180b49d44bbf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:51.953950 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.network.security_group_api [None req-f3bbd301-cdbb-4315-978b-180b49d44bbf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Adding security group 8d5b79bb-0b8b-4867-b7f3-b5719866b04b to port 053f2a29-0f5c-4365-8bc1-9f22a94101d9 Aug 31 12:41:52.265811 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-f3bbd301-cdbb-4315-978b-180b49d44bbf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "POST /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36/action" status: 202 len: 0 microversion: 2.1 time: 0.706593 Aug 31 12:41:52.266907 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 503/1017] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Aug 31 12:41:51 2022] POST /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36/action => generated 0 bytes in 708 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:41:52.276522 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-dcd956b1-6c32-45ad-a822-efd1b4c9629c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:52.277277 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-dcd956b1-6c32-45ad-a822-efd1b4c9629c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:52.280672 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:52.286343 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-dcd956b1-6c32-45ad-a822-efd1b4c9629c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:52.286947 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-dcd956b1-6c32-45ad-a822-efd1b4c9629c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:52.287470 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-dcd956b1-6c32-45ad-a822-efd1b4c9629c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:52.288241 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-dcd956b1-6c32-45ad-a822-efd1b4c9629c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:52.288761 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-dcd956b1-6c32-45ad-a822-efd1b4c9629c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:52.289239 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-dcd956b1-6c32-45ad-a822-efd1b4c9629c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:52.296683 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:52.450559 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-dcd956b1-6c32-45ad-a822-efd1b4c9629c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:52.459109 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-dcd956b1-6c32-45ad-a822-efd1b4c9629c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1760 microversion: 2.1 time: 0.186607 Aug 31 12:41:52.459712 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 515/1018] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:52 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1760 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:52.521607 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-0c71dd57-d268-4ddc-a536-fdafa98894f0 req-cb5a06d3-aaee-4e70-9f1b-36daaaf3f6b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4498593-a0a3-4d64-a784-cb171ef2ed36", "tag": "053f2a29-0f5c-4365-8bc1-9f22a94101d9"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:41:52.526510 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:52.533141 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-0c71dd57-d268-4ddc-a536-fdafa98894f0 req-cb5a06d3-aaee-4e70-9f1b-36daaaf3f6b4 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:52.533625 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-0c71dd57-d268-4ddc-a536-fdafa98894f0 req-cb5a06d3-aaee-4e70-9f1b-36daaaf3f6b4 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:52.534050 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-0c71dd57-d268-4ddc-a536-fdafa98894f0 req-cb5a06d3-aaee-4e70-9f1b-36daaaf3f6b4 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:52.538152 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=65 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:52.547213 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-0c71dd57-d268-4ddc-a536-fdafa98894f0 req-cb5a06d3-aaee-4e70-9f1b-36daaaf3f6b4 service nova] Creating event network-changed:053f2a29-0f5c-4365-8bc1-9f22a94101d9 for instance e4498593-a0a3-4d64-a784-cb171ef2ed36 on hv-cinder-85528 Aug 31 12:41:52.552273 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-0c71dd57-d268-4ddc-a536-fdafa98894f0 req-cb5a06d3-aaee-4e70-9f1b-36daaaf3f6b4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034284 Aug 31 12:41:52.552870 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 504/1019] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:42:14.926119 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-adfb3ea3-5578-4a9d-92b7-0aa0b304dba6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:42:14.928317 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-adfb3ea3-5578-4a9d-92b7-0aa0b304dba6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:14.930712 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_api:SELECT=1 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:42:14.931371 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=5 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:42:14.937656 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-adfb3ea3-5578-4a9d-92b7-0aa0b304dba6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:14.938202 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-adfb3ea3-5578-4a9d-92b7-0aa0b304dba6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:14.938630 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-adfb3ea3-5578-4a9d-92b7-0aa0b304dba6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:14.939354 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-adfb3ea3-5578-4a9d-92b7-0aa0b304dba6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:14.939805 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-adfb3ea3-5578-4a9d-92b7-0aa0b304dba6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:14.940219 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-adfb3ea3-5578-4a9d-92b7-0aa0b304dba6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:15.015135 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-adfb3ea3-5578-4a9d-92b7-0aa0b304dba6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "POST /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36/action" status: 202 len: 0 microversion: 2.1 time: 0.092740 Aug 31 12:42:15.015876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 516/1020] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Aug 31 12:42:14 2022] POST /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:42:15.023814 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_api:SELECT=1 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:42:15.024556 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=1 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:42:15.029638 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-e3f1a929-957e-42b4-9ea0-04f7a3353ae5 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:15.030467 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-e3f1a929-957e-42b4-9ea0-04f7a3353ae5 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:15.038741 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e3f1a929-957e-42b4-9ea0-04f7a3353ae5 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:15.039456 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e3f1a929-957e-42b4-9ea0-04f7a3353ae5 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:15.040216 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e3f1a929-957e-42b4-9ea0-04f7a3353ae5 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:15.040937 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e3f1a929-957e-42b4-9ea0-04f7a3353ae5 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:15.041395 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e3f1a929-957e-42b4-9ea0-04f7a3353ae5 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:15.041818 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e3f1a929-957e-42b4-9ea0-04f7a3353ae5 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:15.279582 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-e3f1a929-957e-42b4-9ea0-04f7a3353ae5 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:15.287925 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-e3f1a929-957e-42b4-9ea0-04f7a3353ae5 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1752 microversion: 2.1 time: 0.265706 Aug 31 12:42:15.288498 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 505/1021] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:15 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1752 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:15.599602 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-d3921b75-c9e1-4d1e-a74d-4f89face1483 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:42:15.600229 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-d3921b75-c9e1-4d1e-a74d-4f89face1483 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:15.607089 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d3921b75-c9e1-4d1e-a74d-4f89face1483 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:15.607598 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d3921b75-c9e1-4d1e-a74d-4f89face1483 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:15.608029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d3921b75-c9e1-4d1e-a74d-4f89face1483 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:15.608721 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d3921b75-c9e1-4d1e-a74d-4f89face1483 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:15.609173 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d3921b75-c9e1-4d1e-a74d-4f89face1483 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:15.609593 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-d3921b75-c9e1-4d1e-a74d-4f89face1483 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:15.634444 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.objects.instance [None req-d3921b75-c9e1-4d1e-a74d-4f89face1483 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lazy-loading 'flavor' on Instance uuid 68593769-d63a-425c-8988-3def34259a96 {{(pid=120749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:42:15.708575 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-d3921b75-c9e1-4d1e-a74d-4f89face1483 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "POST /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96/action" status: 202 len: 0 microversion: 2.1 time: 0.115800 Aug 31 12:42:15.709194 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 517/1022] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Aug 31 12:42:15 2022] POST /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:42:15.718394 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-faf97830-9a3c-4cbb-9fa2-313b928cf46c tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:15.719140 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-faf97830-9a3c-4cbb-9fa2-313b928cf46c tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:15.725427 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-faf97830-9a3c-4cbb-9fa2-313b928cf46c tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:15.725916 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-faf97830-9a3c-4cbb-9fa2-313b928cf46c tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:15.726345 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-faf97830-9a3c-4cbb-9fa2-313b928cf46c tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:15.727079 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-faf97830-9a3c-4cbb-9fa2-313b928cf46c tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:15.727765 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-faf97830-9a3c-4cbb-9fa2-313b928cf46c tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:15.728190 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-faf97830-9a3c-4cbb-9fa2-313b928cf46c tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:15.872000 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-faf97830-9a3c-4cbb-9fa2-313b928cf46c tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:15.880809 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-faf97830-9a3c-4cbb-9fa2-313b928cf46c tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1569 microversion: 2.1 time: 0.166496 Aug 31 12:42:15.881419 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 506/1023] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:15 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:42:16.309573 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-f067d9f7-fc7c-41d4-9dad-feebfc016c06 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:16.310423 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-f067d9f7-fc7c-41d4-9dad-feebfc016c06 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:16.316537 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f067d9f7-fc7c-41d4-9dad-feebfc016c06 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:16.317010 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f067d9f7-fc7c-41d4-9dad-feebfc016c06 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:16.317440 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f067d9f7-fc7c-41d4-9dad-feebfc016c06 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:16.318115 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f067d9f7-fc7c-41d4-9dad-feebfc016c06 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:16.318562 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f067d9f7-fc7c-41d4-9dad-feebfc016c06 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:16.319014 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-f067d9f7-fc7c-41d4-9dad-feebfc016c06 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:16.460857 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-f067d9f7-fc7c-41d4-9dad-feebfc016c06 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:16.469562 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-f067d9f7-fc7c-41d4-9dad-feebfc016c06 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1757 microversion: 2.1 time: 0.164167 Aug 31 12:42:16.470122 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 518/1024] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:16 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:16.901831 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-658d8fce-0496-4b28-8757-5b210a146e8e tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:16.902429 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-658d8fce-0496-4b28-8757-5b210a146e8e tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:16.909078 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-658d8fce-0496-4b28-8757-5b210a146e8e tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:16.909559 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-658d8fce-0496-4b28-8757-5b210a146e8e tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:16.909996 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-658d8fce-0496-4b28-8757-5b210a146e8e tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:16.910687 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-658d8fce-0496-4b28-8757-5b210a146e8e tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:16.911174 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-658d8fce-0496-4b28-8757-5b210a146e8e tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:16.911602 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-658d8fce-0496-4b28-8757-5b210a146e8e tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:17.041103 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-658d8fce-0496-4b28-8757-5b210a146e8e tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:17.049087 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-658d8fce-0496-4b28-8757-5b210a146e8e tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1569 microversion: 2.1 time: 0.151192 Aug 31 12:42:17.049649 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 507/1025] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:16 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:17.490633 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-8291d28f-4e63-4d3b-aeed-453c73d98e4a tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:17.491260 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-8291d28f-4e63-4d3b-aeed-453c73d98e4a tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:17.498579 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8291d28f-4e63-4d3b-aeed-453c73d98e4a tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:17.499148 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8291d28f-4e63-4d3b-aeed-453c73d98e4a tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:17.499578 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8291d28f-4e63-4d3b-aeed-453c73d98e4a tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:17.500318 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8291d28f-4e63-4d3b-aeed-453c73d98e4a tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:17.500718 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8291d28f-4e63-4d3b-aeed-453c73d98e4a tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:17.501142 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8291d28f-4e63-4d3b-aeed-453c73d98e4a tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:17.643488 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8291d28f-4e63-4d3b-aeed-453c73d98e4a tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:17.651589 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-8291d28f-4e63-4d3b-aeed-453c73d98e4a tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1757 microversion: 2.1 time: 0.164824 Aug 31 12:42:17.652147 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 519/1026] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:17 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:18.071609 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-6930c94b-210e-40a6-9419-e942dcf3b89d tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:18.072572 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-6930c94b-210e-40a6-9419-e942dcf3b89d tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:18.080411 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6930c94b-210e-40a6-9419-e942dcf3b89d tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:18.080900 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6930c94b-210e-40a6-9419-e942dcf3b89d tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:18.081341 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6930c94b-210e-40a6-9419-e942dcf3b89d tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:18.082049 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6930c94b-210e-40a6-9419-e942dcf3b89d tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:18.082504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6930c94b-210e-40a6-9419-e942dcf3b89d tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:18.082958 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-6930c94b-210e-40a6-9419-e942dcf3b89d tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:18.235234 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-6930c94b-210e-40a6-9419-e942dcf3b89d tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:18.243859 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-6930c94b-210e-40a6-9419-e942dcf3b89d tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1569 microversion: 2.1 time: 0.176856 Aug 31 12:42:18.244443 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 508/1027] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:18 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:18.673297 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-2f73343e-9e42-4ebb-ba35-6eb22b9c3b27 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:18.673881 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-2f73343e-9e42-4ebb-ba35-6eb22b9c3b27 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:18.681016 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2f73343e-9e42-4ebb-ba35-6eb22b9c3b27 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:18.681538 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2f73343e-9e42-4ebb-ba35-6eb22b9c3b27 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:18.681978 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2f73343e-9e42-4ebb-ba35-6eb22b9c3b27 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:18.683175 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2f73343e-9e42-4ebb-ba35-6eb22b9c3b27 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:18.683175 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2f73343e-9e42-4ebb-ba35-6eb22b9c3b27 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:18.683711 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2f73343e-9e42-4ebb-ba35-6eb22b9c3b27 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:18.842898 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-2f73343e-9e42-4ebb-ba35-6eb22b9c3b27 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:18.851054 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-2f73343e-9e42-4ebb-ba35-6eb22b9c3b27 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1757 microversion: 2.1 time: 0.181625 Aug 31 12:42:18.851623 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 520/1028] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:18 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:19.271086 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-f7ddd36c-058b-432a-8808-279271dac858 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:19.271696 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-f7ddd36c-058b-432a-8808-279271dac858 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:19.278068 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f7ddd36c-058b-432a-8808-279271dac858 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:19.279241 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f7ddd36c-058b-432a-8808-279271dac858 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:19.279544 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f7ddd36c-058b-432a-8808-279271dac858 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:19.280319 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f7ddd36c-058b-432a-8808-279271dac858 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:19.280767 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f7ddd36c-058b-432a-8808-279271dac858 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:19.281186 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f7ddd36c-058b-432a-8808-279271dac858 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:19.414729 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f7ddd36c-058b-432a-8808-279271dac858 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:19.422684 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-f7ddd36c-058b-432a-8808-279271dac858 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1569 microversion: 2.1 time: 0.155558 Aug 31 12:42:19.423284 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 509/1029] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:19 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:19.873227 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-c94f3dc0-3576-4193-899f-bff53f5a654c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:19.873835 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-c94f3dc0-3576-4193-899f-bff53f5a654c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:19.879766 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c94f3dc0-3576-4193-899f-bff53f5a654c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:19.880251 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c94f3dc0-3576-4193-899f-bff53f5a654c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:19.880689 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c94f3dc0-3576-4193-899f-bff53f5a654c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:19.881369 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c94f3dc0-3576-4193-899f-bff53f5a654c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:19.881821 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c94f3dc0-3576-4193-899f-bff53f5a654c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:19.882244 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c94f3dc0-3576-4193-899f-bff53f5a654c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:20.023940 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-c94f3dc0-3576-4193-899f-bff53f5a654c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:20.032876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-c94f3dc0-3576-4193-899f-bff53f5a654c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1757 microversion: 2.1 time: 0.164442 Aug 31 12:42:20.033441 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 521/1030] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:19 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:20.443698 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-4bcce157-186b-49ae-a4f9-98f0805e0744 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:20.444304 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-4bcce157-186b-49ae-a4f9-98f0805e0744 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:20.451514 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4bcce157-186b-49ae-a4f9-98f0805e0744 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:20.452009 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4bcce157-186b-49ae-a4f9-98f0805e0744 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:20.452442 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4bcce157-186b-49ae-a4f9-98f0805e0744 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:20.453144 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4bcce157-186b-49ae-a4f9-98f0805e0744 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:20.453627 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4bcce157-186b-49ae-a4f9-98f0805e0744 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:20.454046 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4bcce157-186b-49ae-a4f9-98f0805e0744 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:20.584744 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-4bcce157-186b-49ae-a4f9-98f0805e0744 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:20.592539 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-4bcce157-186b-49ae-a4f9-98f0805e0744 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1569 microversion: 2.1 time: 0.152786 Aug 31 12:42:20.593117 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 510/1031] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:20 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:21.054822 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-35939f7c-6649-40fe-9e72-e96c2874cbfc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:21.055456 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-35939f7c-6649-40fe-9e72-e96c2874cbfc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:21.062438 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-35939f7c-6649-40fe-9e72-e96c2874cbfc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:21.062951 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-35939f7c-6649-40fe-9e72-e96c2874cbfc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:21.063388 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-35939f7c-6649-40fe-9e72-e96c2874cbfc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:21.064080 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-35939f7c-6649-40fe-9e72-e96c2874cbfc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:21.064535 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-35939f7c-6649-40fe-9e72-e96c2874cbfc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:21.064958 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-35939f7c-6649-40fe-9e72-e96c2874cbfc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:21.214755 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-35939f7c-6649-40fe-9e72-e96c2874cbfc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:21.223121 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-35939f7c-6649-40fe-9e72-e96c2874cbfc tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1757 microversion: 2.1 time: 0.172124 Aug 31 12:42:21.223701 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 522/1032] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:21 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:21.613625 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-7f7459a7-8169-46ff-bcd2-c575becb2da9 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:21.614425 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-7f7459a7-8169-46ff-bcd2-c575becb2da9 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:21.621073 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7f7459a7-8169-46ff-bcd2-c575becb2da9 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:21.621555 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7f7459a7-8169-46ff-bcd2-c575becb2da9 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:21.622262 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7f7459a7-8169-46ff-bcd2-c575becb2da9 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:21.622967 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7f7459a7-8169-46ff-bcd2-c575becb2da9 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:21.623421 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7f7459a7-8169-46ff-bcd2-c575becb2da9 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:21.623904 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-7f7459a7-8169-46ff-bcd2-c575becb2da9 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:21.761109 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-7f7459a7-8169-46ff-bcd2-c575becb2da9 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:21.769417 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-7f7459a7-8169-46ff-bcd2-c575becb2da9 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1569 microversion: 2.1 time: 0.159744 Aug 31 12:42:21.769981 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 511/1033] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:21 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:22.245014 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-ecf7173c-165b-4a80-82c4-0e3a038ee774 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:22.245558 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-ecf7173c-165b-4a80-82c4-0e3a038ee774 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:22.252257 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ecf7173c-165b-4a80-82c4-0e3a038ee774 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:22.252743 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ecf7173c-165b-4a80-82c4-0e3a038ee774 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:22.253177 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ecf7173c-165b-4a80-82c4-0e3a038ee774 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:22.253871 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ecf7173c-165b-4a80-82c4-0e3a038ee774 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:22.254319 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ecf7173c-165b-4a80-82c4-0e3a038ee774 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:22.254739 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ecf7173c-165b-4a80-82c4-0e3a038ee774 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:22.397060 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-ecf7173c-165b-4a80-82c4-0e3a038ee774 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:22.405327 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-ecf7173c-165b-4a80-82c4-0e3a038ee774 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1757 microversion: 2.1 time: 0.164133 Aug 31 12:42:22.405990 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 523/1034] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:22 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:22.791470 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-a34a41ec-4131-453c-8121-c6b665edf364 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:22.792021 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-a34a41ec-4131-453c-8121-c6b665edf364 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:22.799043 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a34a41ec-4131-453c-8121-c6b665edf364 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:22.799523 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a34a41ec-4131-453c-8121-c6b665edf364 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:22.799952 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a34a41ec-4131-453c-8121-c6b665edf364 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:22.800628 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a34a41ec-4131-453c-8121-c6b665edf364 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:22.801076 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a34a41ec-4131-453c-8121-c6b665edf364 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:22.801493 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-a34a41ec-4131-453c-8121-c6b665edf364 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:22.932525 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-a34a41ec-4131-453c-8121-c6b665edf364 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:22.940599 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-a34a41ec-4131-453c-8121-c6b665edf364 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1569 microversion: 2.1 time: 0.153098 Aug 31 12:42:22.941160 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 512/1035] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:22 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:23.426407 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-492ed128-ef33-437d-a104-17e80cdb47c5 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:23.427058 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-492ed128-ef33-437d-a104-17e80cdb47c5 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:23.433341 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-492ed128-ef33-437d-a104-17e80cdb47c5 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:23.433820 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-492ed128-ef33-437d-a104-17e80cdb47c5 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:23.434244 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-492ed128-ef33-437d-a104-17e80cdb47c5 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:23.434948 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-492ed128-ef33-437d-a104-17e80cdb47c5 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:23.435397 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-492ed128-ef33-437d-a104-17e80cdb47c5 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:23.435813 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-492ed128-ef33-437d-a104-17e80cdb47c5 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:23.579644 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-492ed128-ef33-437d-a104-17e80cdb47c5 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:23.587867 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-492ed128-ef33-437d-a104-17e80cdb47c5 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1757 microversion: 2.1 time: 0.165368 Aug 31 12:42:23.588436 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 524/1036] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:23 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:23.961718 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-bc7a75bd-6ac4-4246-801f-00b9470d2a54 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:23.962321 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-bc7a75bd-6ac4-4246-801f-00b9470d2a54 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:23.968948 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bc7a75bd-6ac4-4246-801f-00b9470d2a54 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:23.969358 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bc7a75bd-6ac4-4246-801f-00b9470d2a54 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:23.969794 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bc7a75bd-6ac4-4246-801f-00b9470d2a54 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:23.970473 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bc7a75bd-6ac4-4246-801f-00b9470d2a54 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:23.970946 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bc7a75bd-6ac4-4246-801f-00b9470d2a54 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:23.971366 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bc7a75bd-6ac4-4246-801f-00b9470d2a54 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:24.102383 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-bc7a75bd-6ac4-4246-801f-00b9470d2a54 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:24.110703 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-bc7a75bd-6ac4-4246-801f-00b9470d2a54 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1569 microversion: 2.1 time: 0.152858 Aug 31 12:42:24.111289 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 513/1037] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:23 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:24.609580 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-203025e9-a9f7-46b2-8829-3f933decfb0f tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:24.610195 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-203025e9-a9f7-46b2-8829-3f933decfb0f tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:24.616853 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-203025e9-a9f7-46b2-8829-3f933decfb0f tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:24.617337 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-203025e9-a9f7-46b2-8829-3f933decfb0f tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:24.617791 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-203025e9-a9f7-46b2-8829-3f933decfb0f tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:24.618473 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-203025e9-a9f7-46b2-8829-3f933decfb0f tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:24.618957 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-203025e9-a9f7-46b2-8829-3f933decfb0f tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:24.619390 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-203025e9-a9f7-46b2-8829-3f933decfb0f tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:24.767541 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-203025e9-a9f7-46b2-8829-3f933decfb0f tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:24.775760 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-203025e9-a9f7-46b2-8829-3f933decfb0f tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1757 microversion: 2.1 time: 0.170094 Aug 31 12:42:24.776330 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 525/1038] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:24 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:42:25.132968 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-681a9c62-f862-4ecd-b825-b391de3cc237 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:25.133561 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-681a9c62-f862-4ecd-b825-b391de3cc237 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:25.140729 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-681a9c62-f862-4ecd-b825-b391de3cc237 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:25.141212 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-681a9c62-f862-4ecd-b825-b391de3cc237 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:25.141644 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-681a9c62-f862-4ecd-b825-b391de3cc237 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:25.142330 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-681a9c62-f862-4ecd-b825-b391de3cc237 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:25.142781 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-681a9c62-f862-4ecd-b825-b391de3cc237 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:25.143240 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-681a9c62-f862-4ecd-b825-b391de3cc237 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:25.273794 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-681a9c62-f862-4ecd-b825-b391de3cc237 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:25.281581 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-681a9c62-f862-4ecd-b825-b391de3cc237 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1569 microversion: 2.1 time: 0.152500 Aug 31 12:42:25.282146 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 514/1039] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:25 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:25.798416 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-b42e4dac-415b-4f7d-9c25-520b8a5515cf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:25.799033 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-b42e4dac-415b-4f7d-9c25-520b8a5515cf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:25.805756 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b42e4dac-415b-4f7d-9c25-520b8a5515cf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:25.806239 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b42e4dac-415b-4f7d-9c25-520b8a5515cf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:25.806706 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b42e4dac-415b-4f7d-9c25-520b8a5515cf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:25.807426 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b42e4dac-415b-4f7d-9c25-520b8a5515cf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:25.807879 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b42e4dac-415b-4f7d-9c25-520b8a5515cf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:25.808298 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b42e4dac-415b-4f7d-9c25-520b8a5515cf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:25.957753 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-b42e4dac-415b-4f7d-9c25-520b8a5515cf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:25.966105 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-b42e4dac-415b-4f7d-9c25-520b8a5515cf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1757 microversion: 2.1 time: 0.172284 Aug 31 12:42:25.966678 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 526/1040] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:25 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:26.302404 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-59c170ec-435d-40a2-95ac-916c6fcc59c3 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:26.303019 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-59c170ec-435d-40a2-95ac-916c6fcc59c3 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:26.309478 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-59c170ec-435d-40a2-95ac-916c6fcc59c3 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:26.309963 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-59c170ec-435d-40a2-95ac-916c6fcc59c3 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:26.310396 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-59c170ec-435d-40a2-95ac-916c6fcc59c3 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:26.311121 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-59c170ec-435d-40a2-95ac-916c6fcc59c3 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:26.311637 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-59c170ec-435d-40a2-95ac-916c6fcc59c3 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:26.312056 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-59c170ec-435d-40a2-95ac-916c6fcc59c3 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:26.462630 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-59c170ec-435d-40a2-95ac-916c6fcc59c3 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:26.471019 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-59c170ec-435d-40a2-95ac-916c6fcc59c3 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1569 microversion: 2.1 time: 0.172498 Aug 31 12:42:26.471587 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 515/1041] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:26 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:26.988295 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-ffcd7450-ef08-4956-86a3-a861d7e1c305 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:26.988951 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-ffcd7450-ef08-4956-86a3-a861d7e1c305 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:26.995697 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ffcd7450-ef08-4956-86a3-a861d7e1c305 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:26.996192 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ffcd7450-ef08-4956-86a3-a861d7e1c305 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:26.996633 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ffcd7450-ef08-4956-86a3-a861d7e1c305 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:26.997590 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ffcd7450-ef08-4956-86a3-a861d7e1c305 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:26.998049 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ffcd7450-ef08-4956-86a3-a861d7e1c305 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:26.998475 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-ffcd7450-ef08-4956-86a3-a861d7e1c305 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:27.151166 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-ffcd7450-ef08-4956-86a3-a861d7e1c305 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:27.160110 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-ffcd7450-ef08-4956-86a3-a861d7e1c305 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1760 microversion: 2.1 time: 0.175737 Aug 31 12:42:27.160680 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 527/1042] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:26 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1760 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:27.493169 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-1c1356cf-5074-441b-805e-c902707dc439 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:27.493825 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-1c1356cf-5074-441b-805e-c902707dc439 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:27.501488 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1c1356cf-5074-441b-805e-c902707dc439 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:27.501970 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1c1356cf-5074-441b-805e-c902707dc439 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:27.502397 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1c1356cf-5074-441b-805e-c902707dc439 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:27.503115 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1c1356cf-5074-441b-805e-c902707dc439 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:27.503568 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1c1356cf-5074-441b-805e-c902707dc439 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:27.503989 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-1c1356cf-5074-441b-805e-c902707dc439 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:27.639084 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-1c1356cf-5074-441b-805e-c902707dc439 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:27.647050 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-1c1356cf-5074-441b-805e-c902707dc439 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1569 microversion: 2.1 time: 0.157652 Aug 31 12:42:27.647618 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 516/1043] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:27 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:42:28.668227 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-5d7acf9a-5bdf-4150-9f04-f0e4edb4b734 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:28.668818 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-5d7acf9a-5bdf-4150-9f04-f0e4edb4b734 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:28.675762 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5d7acf9a-5bdf-4150-9f04-f0e4edb4b734 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:28.676239 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5d7acf9a-5bdf-4150-9f04-f0e4edb4b734 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:28.676662 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5d7acf9a-5bdf-4150-9f04-f0e4edb4b734 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:28.677345 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5d7acf9a-5bdf-4150-9f04-f0e4edb4b734 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:28.677791 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5d7acf9a-5bdf-4150-9f04-f0e4edb4b734 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:28.678204 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-5d7acf9a-5bdf-4150-9f04-f0e4edb4b734 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:28.816296 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-5d7acf9a-5bdf-4150-9f04-f0e4edb4b734 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:28.827513 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-5d7acf9a-5bdf-4150-9f04-f0e4edb4b734 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1569 microversion: 2.1 time: 0.162802 Aug 31 12:42:28.828437 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 528/1044] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:28 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:29.849712 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-bff45a54-d065-4573-9e61-5f77a75ba2b4 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:29.850337 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-bff45a54-d065-4573-9e61-5f77a75ba2b4 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:29.856779 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bff45a54-d065-4573-9e61-5f77a75ba2b4 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:29.857253 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bff45a54-d065-4573-9e61-5f77a75ba2b4 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:29.857686 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bff45a54-d065-4573-9e61-5f77a75ba2b4 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:29.858364 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bff45a54-d065-4573-9e61-5f77a75ba2b4 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:29.858810 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bff45a54-d065-4573-9e61-5f77a75ba2b4 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:29.859249 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-bff45a54-d065-4573-9e61-5f77a75ba2b4 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:29.991508 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-bff45a54-d065-4573-9e61-5f77a75ba2b4 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:29.999622 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-bff45a54-d065-4573-9e61-5f77a75ba2b4 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1510 microversion: 2.1 time: 0.153749 Aug 31 12:42:30.000183 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 517/1045] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:29 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:30.020283 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-2c2b8b2e-1be8-4a04-ad02-a14fccc85638 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:42:30.020910 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-2c2b8b2e-1be8-4a04-ad02-a14fccc85638 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:30.027429 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2c2b8b2e-1be8-4a04-ad02-a14fccc85638 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:30.027917 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2c2b8b2e-1be8-4a04-ad02-a14fccc85638 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:30.028351 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2c2b8b2e-1be8-4a04-ad02-a14fccc85638 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:30.029042 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2c2b8b2e-1be8-4a04-ad02-a14fccc85638 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:30.029501 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2c2b8b2e-1be8-4a04-ad02-a14fccc85638 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:30.030580 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-2c2b8b2e-1be8-4a04-ad02-a14fccc85638 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:30.047165 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:42:30.061801 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-2c2b8b2e-1be8-4a04-ad02-a14fccc85638 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120749) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 12:42:30.125360 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2c2b8b2e-1be8-4a04-ad02-a14fccc85638 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [42d351c3-23ae-4f54-8ad0-65e749b23d05] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 12:42:31.132134 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO oslo.messaging._drivers.impl_rabbit [None req-2c2b8b2e-1be8-4a04-ad02-a14fccc85638 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [42d351c3-23ae-4f54-8ad0-65e749b23d05] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 57242. Aug 31 12:42:31.135204 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-2c2b8b2e-1be8-4a04-ad02-a14fccc85638 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "POST /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96/action" status: 202 len: 0 microversion: 2.1 time: 1.118914 Aug 31 12:42:31.135821 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 529/1046] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Aug 31 12:42:30 2022] POST /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96/action => generated 0 bytes in 1120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:42:31.144402 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-35b560d9-8ce5-40d9-966b-e42b5c369a57 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:31.145005 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-35b560d9-8ce5-40d9-966b-e42b5c369a57 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:31.151420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-35b560d9-8ce5-40d9-966b-e42b5c369a57 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:31.151893 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-35b560d9-8ce5-40d9-966b-e42b5c369a57 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:31.152326 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-35b560d9-8ce5-40d9-966b-e42b5c369a57 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:31.153421 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-35b560d9-8ce5-40d9-966b-e42b5c369a57 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:31.153570 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-35b560d9-8ce5-40d9-966b-e42b5c369a57 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:31.153943 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-35b560d9-8ce5-40d9-966b-e42b5c369a57 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:31.323978 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-35b560d9-8ce5-40d9-966b-e42b5c369a57 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:31.332829 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-35b560d9-8ce5-40d9-966b-e42b5c369a57 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1518 microversion: 2.1 time: 0.192193 Aug 31 12:42:31.333715 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 518/1047] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:31 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1518 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:32.355267 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-c4425e7a-49a1-4e31-8964-fb92b479fc65 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:32.356616 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-c4425e7a-49a1-4e31-8964-fb92b479fc65 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:32.364127 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c4425e7a-49a1-4e31-8964-fb92b479fc65 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:32.364675 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c4425e7a-49a1-4e31-8964-fb92b479fc65 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:32.365062 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c4425e7a-49a1-4e31-8964-fb92b479fc65 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:32.365764 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c4425e7a-49a1-4e31-8964-fb92b479fc65 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:32.366220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c4425e7a-49a1-4e31-8964-fb92b479fc65 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:32.366644 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-c4425e7a-49a1-4e31-8964-fb92b479fc65 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:32.505936 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-c4425e7a-49a1-4e31-8964-fb92b479fc65 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:32.513613 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-c4425e7a-49a1-4e31-8964-fb92b479fc65 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1576 microversion: 2.1 time: 0.162961 Aug 31 12:42:32.514174 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 530/1048] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:32 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:32.654422 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-8d17f894-699e-4c52-b2c2-13aa8d81b7d5 req-44a60a91-4ec3-48f2-9ab4-a449ef29db10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68593769-d63a-425c-8988-3def34259a96", "name": "network-vif-unplugged", "status": "completed", "tag": "c50ac0a0-bbf4-44a3-9255-25ee8afa88e4"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:42:32.665264 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-8d17f894-699e-4c52-b2c2-13aa8d81b7d5 req-44a60a91-4ec3-48f2-9ab4-a449ef29db10 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:32.665746 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-8d17f894-699e-4c52-b2c2-13aa8d81b7d5 req-44a60a91-4ec3-48f2-9ab4-a449ef29db10 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:32.666167 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-8d17f894-699e-4c52-b2c2-13aa8d81b7d5 req-44a60a91-4ec3-48f2-9ab4-a449ef29db10 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:32.679242 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-8d17f894-699e-4c52-b2c2-13aa8d81b7d5 req-44a60a91-4ec3-48f2-9ab4-a449ef29db10 service nova] Creating event network-vif-unplugged:c50ac0a0-bbf4-44a3-9255-25ee8afa88e4 for instance 68593769-d63a-425c-8988-3def34259a96 on hv-cinder-85528 Aug 31 12:42:32.684252 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-8d17f894-699e-4c52-b2c2-13aa8d81b7d5 req-44a60a91-4ec3-48f2-9ab4-a449ef29db10 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033533 Aug 31 12:42:32.684858 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 519/1049] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:42:33.535132 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-24e9b68d-4566-4768-85e4-9502305cbf29 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:33.535740 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-24e9b68d-4566-4768-85e4-9502305cbf29 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:33.542190 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-24e9b68d-4566-4768-85e4-9502305cbf29 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:33.542677 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-24e9b68d-4566-4768-85e4-9502305cbf29 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:33.543148 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-24e9b68d-4566-4768-85e4-9502305cbf29 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:33.543834 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-24e9b68d-4566-4768-85e4-9502305cbf29 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:33.544289 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-24e9b68d-4566-4768-85e4-9502305cbf29 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:33.544707 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-24e9b68d-4566-4768-85e4-9502305cbf29 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:33.676633 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-24e9b68d-4566-4768-85e4-9502305cbf29 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:33.684411 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-24e9b68d-4566-4768-85e4-9502305cbf29 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1576 microversion: 2.1 time: 0.153109 Aug 31 12:42:33.684976 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 531/1050] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:33 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:42:34.707355 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-ce908780-a608-4abf-9a3a-41f41d0891ff tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:34.707988 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-ce908780-a608-4abf-9a3a-41f41d0891ff tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:34.714141 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ce908780-a608-4abf-9a3a-41f41d0891ff tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:34.714611 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ce908780-a608-4abf-9a3a-41f41d0891ff tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:34.715073 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ce908780-a608-4abf-9a3a-41f41d0891ff tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:34.715751 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ce908780-a608-4abf-9a3a-41f41d0891ff tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:34.716197 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ce908780-a608-4abf-9a3a-41f41d0891ff tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:34.716610 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-ce908780-a608-4abf-9a3a-41f41d0891ff tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:34.850982 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-ce908780-a608-4abf-9a3a-41f41d0891ff tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:34.858778 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-ce908780-a608-4abf-9a3a-41f41d0891ff tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1576 microversion: 2.1 time: 0.157021 Aug 31 12:42:34.859358 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 520/1051] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:34 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:35.880845 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-4fd695c1-6cbe-4ade-92f1-4064782c5fd5 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:35.881470 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-4fd695c1-6cbe-4ade-92f1-4064782c5fd5 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:35.887984 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4fd695c1-6cbe-4ade-92f1-4064782c5fd5 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:35.888469 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4fd695c1-6cbe-4ade-92f1-4064782c5fd5 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:35.888905 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4fd695c1-6cbe-4ade-92f1-4064782c5fd5 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:35.889767 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4fd695c1-6cbe-4ade-92f1-4064782c5fd5 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:35.890290 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4fd695c1-6cbe-4ade-92f1-4064782c5fd5 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:35.890715 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4fd695c1-6cbe-4ade-92f1-4064782c5fd5 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:36.021783 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-4fd695c1-6cbe-4ade-92f1-4064782c5fd5 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:36.029454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-4fd695c1-6cbe-4ade-92f1-4064782c5fd5 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1576 microversion: 2.1 time: 0.152481 Aug 31 12:42:36.030081 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 532/1052] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:35 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:37.051913 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-fe4fc496-25b9-4462-bb4c-429368eb8443 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:37.052476 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-fe4fc496-25b9-4462-bb4c-429368eb8443 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:37.059040 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fe4fc496-25b9-4462-bb4c-429368eb8443 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:37.059520 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fe4fc496-25b9-4462-bb4c-429368eb8443 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:37.059948 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fe4fc496-25b9-4462-bb4c-429368eb8443 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:37.060631 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fe4fc496-25b9-4462-bb4c-429368eb8443 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:37.061129 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fe4fc496-25b9-4462-bb4c-429368eb8443 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:37.061723 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fe4fc496-25b9-4462-bb4c-429368eb8443 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:37.192084 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-fe4fc496-25b9-4462-bb4c-429368eb8443 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:37.199848 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-fe4fc496-25b9-4462-bb4c-429368eb8443 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1576 microversion: 2.1 time: 0.152181 Aug 31 12:42:37.200410 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 521/1053] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:37 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:38.221488 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-3bb672e3-a72c-4501-b4c9-382de7778ccf tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:38.222119 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-3bb672e3-a72c-4501-b4c9-382de7778ccf tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:38.228502 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3bb672e3-a72c-4501-b4c9-382de7778ccf tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:38.228991 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3bb672e3-a72c-4501-b4c9-382de7778ccf tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:38.229422 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3bb672e3-a72c-4501-b4c9-382de7778ccf tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:38.230110 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3bb672e3-a72c-4501-b4c9-382de7778ccf tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:38.230560 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3bb672e3-a72c-4501-b4c9-382de7778ccf tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:38.231013 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-3bb672e3-a72c-4501-b4c9-382de7778ccf tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:38.367251 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-3bb672e3-a72c-4501-b4c9-382de7778ccf tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:38.376293 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-3bb672e3-a72c-4501-b4c9-382de7778ccf tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1576 microversion: 2.1 time: 0.158997 Aug 31 12:42:38.376857 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 533/1054] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:38 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:39.396605 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-e17a64b9-ffea-4fce-9c85-46cd0e050501 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:39.397213 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-e17a64b9-ffea-4fce-9c85-46cd0e050501 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:39.403592 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e17a64b9-ffea-4fce-9c85-46cd0e050501 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:39.404074 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e17a64b9-ffea-4fce-9c85-46cd0e050501 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:39.404504 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e17a64b9-ffea-4fce-9c85-46cd0e050501 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:39.405770 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e17a64b9-ffea-4fce-9c85-46cd0e050501 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:39.406245 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e17a64b9-ffea-4fce-9c85-46cd0e050501 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:39.406667 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-e17a64b9-ffea-4fce-9c85-46cd0e050501 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:39.410769 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=100 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:42:39.539574 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-e17a64b9-ffea-4fce-9c85-46cd0e050501 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:39.549353 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-e17a64b9-ffea-4fce-9c85-46cd0e050501 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1576 microversion: 2.1 time: 0.156661 Aug 31 12:42:39.549914 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 522/1055] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:39 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:40.570010 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-e7ce4d14-5ce2-40ad-b61a-194b4e9b4115 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:40.570618 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-e7ce4d14-5ce2-40ad-b61a-194b4e9b4115 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:40.577835 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e7ce4d14-5ce2-40ad-b61a-194b4e9b4115 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:40.578334 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e7ce4d14-5ce2-40ad-b61a-194b4e9b4115 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:40.578766 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e7ce4d14-5ce2-40ad-b61a-194b4e9b4115 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:40.579485 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e7ce4d14-5ce2-40ad-b61a-194b4e9b4115 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:40.579938 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e7ce4d14-5ce2-40ad-b61a-194b4e9b4115 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:40.580360 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-e7ce4d14-5ce2-40ad-b61a-194b4e9b4115 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:40.725412 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-e7ce4d14-5ce2-40ad-b61a-194b4e9b4115 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:40.735721 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-e7ce4d14-5ce2-40ad-b61a-194b4e9b4115 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1576 microversion: 2.1 time: 0.169479 Aug 31 12:42:40.736398 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 534/1056] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:40 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:41.757692 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-70dac51a-9b00-46a1-ab1f-2d18d4b6e353 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:41.758298 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-70dac51a-9b00-46a1-ab1f-2d18d4b6e353 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:41.764940 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-70dac51a-9b00-46a1-ab1f-2d18d4b6e353 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:41.765424 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-70dac51a-9b00-46a1-ab1f-2d18d4b6e353 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:41.765848 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-70dac51a-9b00-46a1-ab1f-2d18d4b6e353 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:41.766534 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-70dac51a-9b00-46a1-ab1f-2d18d4b6e353 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:41.767071 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-70dac51a-9b00-46a1-ab1f-2d18d4b6e353 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:41.767488 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-70dac51a-9b00-46a1-ab1f-2d18d4b6e353 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:41.919701 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-70dac51a-9b00-46a1-ab1f-2d18d4b6e353 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:41.927776 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-70dac51a-9b00-46a1-ab1f-2d18d4b6e353 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1576 microversion: 2.1 time: 0.173985 Aug 31 12:42:41.928338 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 523/1057] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:41 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:42.784444 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-f9a5dd9a-ba1a-4045-a6e8-fb413a1e960f req-75b80a2f-7601-4d21-8bc9-bbb36181f692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68593769-d63a-425c-8988-3def34259a96", "name": "network-vif-plugged", "status": "completed", "tag": "c50ac0a0-bbf4-44a3-9255-25ee8afa88e4"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:42:42.794803 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-f9a5dd9a-ba1a-4045-a6e8-fb413a1e960f req-75b80a2f-7601-4d21-8bc9-bbb36181f692 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:42.795347 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-f9a5dd9a-ba1a-4045-a6e8-fb413a1e960f req-75b80a2f-7601-4d21-8bc9-bbb36181f692 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:42.796402 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-f9a5dd9a-ba1a-4045-a6e8-fb413a1e960f req-75b80a2f-7601-4d21-8bc9-bbb36181f692 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:42.812825 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-f9a5dd9a-ba1a-4045-a6e8-fb413a1e960f req-75b80a2f-7601-4d21-8bc9-bbb36181f692 service nova] Creating event network-vif-plugged:c50ac0a0-bbf4-44a3-9255-25ee8afa88e4 for instance 68593769-d63a-425c-8988-3def34259a96 on hv-cinder-85528 Aug 31 12:42:42.817905 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-f9a5dd9a-ba1a-4045-a6e8-fb413a1e960f req-75b80a2f-7601-4d21-8bc9-bbb36181f692 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038094 Aug 31 12:42:42.818638 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 535/1058] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:42:42.948920 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-24785a77-962a-4858-b613-01aff3705ece tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:42.950172 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-24785a77-962a-4858-b613-01aff3705ece tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:42.956378 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-24785a77-962a-4858-b613-01aff3705ece tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:42.956859 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-24785a77-962a-4858-b613-01aff3705ece tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:42.957307 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-24785a77-962a-4858-b613-01aff3705ece tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:42.957989 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-24785a77-962a-4858-b613-01aff3705ece tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:42.958484 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-24785a77-962a-4858-b613-01aff3705ece tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:42.959030 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-24785a77-962a-4858-b613-01aff3705ece tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:43.141641 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-24785a77-962a-4858-b613-01aff3705ece tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:43.149835 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-24785a77-962a-4858-b613-01aff3705ece tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1576 microversion: 2.1 time: 0.204728 Aug 31 12:42:43.150454 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 524/1059] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:42 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1576 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:44.172366 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-7fc46d9e-5a7c-4998-903b-625d6b6ea2e7 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:44.173177 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-7fc46d9e-5a7c-4998-903b-625d6b6ea2e7 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:44.179342 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7fc46d9e-5a7c-4998-903b-625d6b6ea2e7 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:44.179815 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7fc46d9e-5a7c-4998-903b-625d6b6ea2e7 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:44.180252 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7fc46d9e-5a7c-4998-903b-625d6b6ea2e7 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:44.180927 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7fc46d9e-5a7c-4998-903b-625d6b6ea2e7 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:44.181380 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7fc46d9e-5a7c-4998-903b-625d6b6ea2e7 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:44.181793 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-7fc46d9e-5a7c-4998-903b-625d6b6ea2e7 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:44.325088 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-7fc46d9e-5a7c-4998-903b-625d6b6ea2e7 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:44.333466 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-7fc46d9e-5a7c-4998-903b-625d6b6ea2e7 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1576 microversion: 2.1 time: 0.166012 Aug 31 12:42:44.334029 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 536/1060] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:44 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:45.355420 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-77a723b3-526b-48e6-86e2-ed10c7bd69ea tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:45.356008 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-77a723b3-526b-48e6-86e2-ed10c7bd69ea tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:45.358490 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_api:SELECT=41 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:42:45.364502 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-77a723b3-526b-48e6-86e2-ed10c7bd69ea tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:45.364987 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-77a723b3-526b-48e6-86e2-ed10c7bd69ea tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:45.365422 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-77a723b3-526b-48e6-86e2-ed10c7bd69ea tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:45.366117 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-77a723b3-526b-48e6-86e2-ed10c7bd69ea tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:45.366570 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-77a723b3-526b-48e6-86e2-ed10c7bd69ea tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:45.367045 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-77a723b3-526b-48e6-86e2-ed10c7bd69ea tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:45.498731 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-77a723b3-526b-48e6-86e2-ed10c7bd69ea tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:45.506452 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-77a723b3-526b-48e6-86e2-ed10c7bd69ea tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1563 microversion: 2.1 time: 0.155200 Aug 31 12:42:45.507162 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 525/1061] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:45 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:43:02.209319 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-4ffb48af-7ed0-490b-90a9-015b1f561c74 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-899398892"}} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:43:02.209942 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-4ffb48af-7ed0-490b-90a9-015b1f561c74 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:43:02.212140 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:43:02.212804 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:43:02.223083 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4ffb48af-7ed0-490b-90a9-015b1f561c74 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:02.223580 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4ffb48af-7ed0-490b-90a9-015b1f561c74 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:02.224014 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4ffb48af-7ed0-490b-90a9-015b1f561c74 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:02.224739 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4ffb48af-7ed0-490b-90a9-015b1f561c74 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:02.225200 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4ffb48af-7ed0-490b-90a9-015b1f561c74 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:02.225619 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-4ffb48af-7ed0-490b-90a9-015b1f561c74 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:02.355646 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.network.security_group_api [None req-4ffb48af-7ed0-490b-90a9-015b1f561c74 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Removing security group 8d5b79bb-0b8b-4867-b7f3-b5719866b04b from port 053f2a29-0f5c-4365-8bc1-9f22a94101d9 Aug 31 12:43:02.929844 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_api:SELECT=1 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:43:02.930718 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=22 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:43:02.942644 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-4ffb48af-7ed0-490b-90a9-015b1f561c74 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "POST /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36/action" status: 202 len: 0 microversion: 2.1 time: 0.736154 Aug 31 12:43:02.947328 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 537/1062] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Aug 31 12:43:02 2022] POST /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36/action => generated 0 bytes in 739 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:43:02.994524 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-9db502ea-3680-48a5-a669-f28915c97cf5 req-a75c7dc5-cead-4cb9-bef0-790f8db542f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4498593-a0a3-4d64-a784-cb171ef2ed36", "tag": "053f2a29-0f5c-4365-8bc1-9f22a94101d9"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:43:03.004619 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-9db502ea-3680-48a5-a669-f28915c97cf5 req-a75c7dc5-cead-4cb9-bef0-790f8db542f3 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:03.005111 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-9db502ea-3680-48a5-a669-f28915c97cf5 req-a75c7dc5-cead-4cb9-bef0-790f8db542f3 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:03.005523 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-9db502ea-3680-48a5-a669-f28915c97cf5 req-a75c7dc5-cead-4cb9-bef0-790f8db542f3 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:03.018069 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-9db502ea-3680-48a5-a669-f28915c97cf5 req-a75c7dc5-cead-4cb9-bef0-790f8db542f3 service nova] Creating event network-changed:053f2a29-0f5c-4365-8bc1-9f22a94101d9 for instance e4498593-a0a3-4d64-a784-cb171ef2ed36 on hv-cinder-85528 Aug 31 12:43:03.023156 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-9db502ea-3680-48a5-a669-f28915c97cf5 req-a75c7dc5-cead-4cb9-bef0-790f8db542f3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097767 Aug 31 12:43:03.024080 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 526/1063] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:43:04.559960 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [req-40aa3a20-7346-47e3-8189-fa1930c05a7c req-474ea357-db52-4955-9544-8bdfd01cb600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4498593-a0a3-4d64-a784-cb171ef2ed36", "tag": "053f2a29-0f5c-4365-8bc1-9f22a94101d9"}]} {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:43:04.560674 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-b2e92980-2a1d-4550-a57c-35a5eaabb5b7 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:43:04.560674 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-b2e92980-2a1d-4550-a57c-35a5eaabb5b7 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:43:04.568233 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b2e92980-2a1d-4550-a57c-35a5eaabb5b7 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:04.568738 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b2e92980-2a1d-4550-a57c-35a5eaabb5b7 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:04.569181 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b2e92980-2a1d-4550-a57c-35a5eaabb5b7 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:04.569906 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b2e92980-2a1d-4550-a57c-35a5eaabb5b7 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:04.570373 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b2e92980-2a1d-4550-a57c-35a5eaabb5b7 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:04.570806 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b2e92980-2a1d-4550-a57c-35a5eaabb5b7 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:04.572173 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-40aa3a20-7346-47e3-8189-fa1930c05a7c req-474ea357-db52-4955-9544-8bdfd01cb600 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:04.573085 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-40aa3a20-7346-47e3-8189-fa1930c05a7c req-474ea357-db52-4955-9544-8bdfd01cb600 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:04.573943 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [req-40aa3a20-7346-47e3-8189-fa1930c05a7c req-474ea357-db52-4955-9544-8bdfd01cb600 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:04.587256 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.compute.server_external_events [req-40aa3a20-7346-47e3-8189-fa1930c05a7c req-474ea357-db52-4955-9544-8bdfd01cb600 service nova] Creating event network-changed:053f2a29-0f5c-4365-8bc1-9f22a94101d9 for instance e4498593-a0a3-4d64-a784-cb171ef2ed36 on hv-cinder-85528 Aug 31 12:43:04.599973 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [req-40aa3a20-7346-47e3-8189-fa1930c05a7c req-474ea357-db52-4955-9544-8bdfd01cb600 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044409 Aug 31 12:43:04.601208 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 527/1064] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:43:04.675840 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.objects.instance [None req-b2e92980-2a1d-4550-a57c-35a5eaabb5b7 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lazy-loading 'services' on Instance uuid e4498593-a0a3-4d64-a784-cb171ef2ed36 {{(pid=120749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:43:04.754563 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-b2e92980-2a1d-4550-a57c-35a5eaabb5b7 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36/os-volume_attachments/f9d96859-e1dd-4cbd-82e1-ce103d691795" status: 202 len: 0 microversion: 2.1 time: 0.200212 Aug 31 12:43:04.755202 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 538/1065] 10.222.0.79 () {58 vars in 1416 bytes} [Wed Aug 31 12:43:04 2022] DELETE /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36/os-volume_attachments/f9d96859-e1dd-4cbd-82e1-ce103d691795 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:43:04.765802 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-4040b93c-1253-46b9-b4eb-7b123157c4a5 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:43:04.769037 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-4040b93c-1253-46b9-b4eb-7b123157c4a5 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:43:04.778183 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4040b93c-1253-46b9-b4eb-7b123157c4a5 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:04.779364 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4040b93c-1253-46b9-b4eb-7b123157c4a5 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:04.781039 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4040b93c-1253-46b9-b4eb-7b123157c4a5 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:04.782560 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4040b93c-1253-46b9-b4eb-7b123157c4a5 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:04.783446 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4040b93c-1253-46b9-b4eb-7b123157c4a5 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:04.783876 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-4040b93c-1253-46b9-b4eb-7b123157c4a5 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:04.816192 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-4040b93c-1253-46b9-b4eb-7b123157c4a5 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055651 Aug 31 12:43:04.817255 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 528/1066] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 31 12:43:04 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:43:05.831016 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-bdc9d5b5-fdbd-4dcc-acb7-6a5db72f354d tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:43:05.833261 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-bdc9d5b5-fdbd-4dcc-acb7-6a5db72f354d tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:43:05.839782 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bdc9d5b5-fdbd-4dcc-acb7-6a5db72f354d tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:05.840266 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bdc9d5b5-fdbd-4dcc-acb7-6a5db72f354d tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:05.840696 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bdc9d5b5-fdbd-4dcc-acb7-6a5db72f354d tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:05.841384 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bdc9d5b5-fdbd-4dcc-acb7-6a5db72f354d tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:05.841831 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bdc9d5b5-fdbd-4dcc-acb7-6a5db72f354d tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:05.842249 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-bdc9d5b5-fdbd-4dcc-acb7-6a5db72f354d tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:05.873419 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-bdc9d5b5-fdbd-4dcc-acb7-6a5db72f354d tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047041 Aug 31 12:43:05.873997 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 539/1067] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 31 12:43:05 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 12:43:05.886712 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-14b59fd4-e0c6-442a-b151-04bf8aebfa2b tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:43:05.887633 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-14b59fd4-e0c6-442a-b151-04bf8aebfa2b tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:43:05.895811 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-14b59fd4-e0c6-442a-b151-04bf8aebfa2b tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:05.896401 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-14b59fd4-e0c6-442a-b151-04bf8aebfa2b tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:05.896867 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-14b59fd4-e0c6-442a-b151-04bf8aebfa2b tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:05.897646 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-14b59fd4-e0c6-442a-b151-04bf8aebfa2b tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:05.898201 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-14b59fd4-e0c6-442a-b151-04bf8aebfa2b tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:05.898702 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-14b59fd4-e0c6-442a-b151-04bf8aebfa2b tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:05.979468 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-14b59fd4-e0c6-442a-b151-04bf8aebfa2b tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] HTTP exception thrown: Instance e4498593-a0a3-4d64-a784-cb171ef2ed36 is not attached to volume f9d96859-e1dd-4cbd-82e1-ce103d691795 Aug 31 12:43:05.982038 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-14b59fd4-e0c6-442a-b151-04bf8aebfa2b tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Request method failure captured: Aug 31 12:43:05.982038 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: DELETE /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36/os-volume_attachments/f9d96859-e1dd-4cbd-82e1-ce103d691795 HTTP/1.1 Aug 31 12:43:05.982038 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:43:05.982038 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:43:05.982038 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:43:05.982038 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 0 Aug 31 12:43:05.982038 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:43:05.982038 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:43:05.982038 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:43:05.982038 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:43:05.982038 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1bjU_dgLbiwqp-IRVVGp4uB0Ethaomby6pXBGbo6cKu0202JcZEn5N5G8oXcGNUiU-ATjr_ZaifI6C61lGpYJkicVzxf-WTQyogqm0BVEEoNBqgDEEiDwFxElOMW7eWfL20jVFf8YZWMOh71DDYfXepKuqYHzFuscwhzGuwW-uS56w Aug 31 12:43:05.982038 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:43:05.982038 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:43:05.982038 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:43:05.982038 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:43:05.982038 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:43:05.982038 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:43:05.982038 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: e8ba32b297b84802941b32e82f3a67e5 Aug 31 12:43:05.982038 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-TestMinimumBasicScenario-99332013 Aug 31 12:43:05.982038 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:43:05.982038 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:43:05.985550 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e8ba32b297b84802941b32e82f3a67e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e8ba32b297b84802941b32e82f3a67e5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e8ba32b297b84802941b32e82f3a67e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e8ba32b297b84802941b32e82f3a67e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:43:05.985550 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-TestMinimumBasicScenario-99332013 Aug 31 12:43:05.985550 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: e8ba32b297b84802941b32e82f3a67e5 Aug 31 12:43:05.985550 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-TestMinimumBasicScenario-99332013 Aug 31 12:43:05.985550 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-TestMinimumBasicScenario-99332013-project Aug 31 12:43:05.985550 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:43:05.985550 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:43:05.985550 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: 463ffd63f6d54b629e160c3476eae261 Aug 31 12:43:05.985550 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-TestMinimumBasicScenario-99332013-project Aug 31 12:43:05.985550 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:43:05.985550 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Instance e4498593-a0a3-4d64-a784-cb171ef2ed36 is not attached to volume f9d96859-e1dd-4cbd-82e1-ce103d691795 Aug 31 12:43:05.986669 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'server_id': 'e4498593-a0a3-4d64-a784-cb171ef2ed36', 'id': 'f9d96859-e1dd-4cbd-82e1-ce103d691795'} Aug 31 12:43:05.986669 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:43:05.986669 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:43:05.986669 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 12:43:05.986669 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 12:43:05.986669 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 12:43:05.986669 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 12:43:05.986669 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 12:43:05.986669 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 12:43:05.986669 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f9d96859-e1dd-4cbd-82e1-ce103d691795. Aug 31 12:43:05.986669 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:43:05.986669 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:43:05.986669 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:43:05.986669 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:43:05.986669 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:43:05.986669 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:43:05.986669 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:43:05.986669 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:43:05.986669 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:43:05.988375 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:43:05.988375 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 12:43:05.988375 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 12:43:05.988375 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4498593-a0a3-4d64-a784-cb171ef2ed36 is not attached to volume f9d96859-e1dd-4cbd-82e1-ce103d691795 Aug 31 12:43:05.988375 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:43:05.988375 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:43:05.988375 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:43:05.988375 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:43:05.988375 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:43:05.988375 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:43:05.988375 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:43:05.988375 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:43:05.988375 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4498593-a0a3-4d64-a784-cb171ef2ed36 is not attached to volume f9d96859-e1dd-4cbd-82e1-ce103d691795 Aug 31 12:43:05.988375 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:43:05.988375 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-14b59fd4-e0c6-442a-b151-04bf8aebfa2b tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Returning 404 to user: Instance e4498593-a0a3-4d64-a784-cb171ef2ed36 is not attached to volume f9d96859-e1dd-4cbd-82e1-ce103d691795 {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:43:05.989540 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-14b59fd4-e0c6-442a-b151-04bf8aebfa2b tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36/os-volume_attachments/f9d96859-e1dd-4cbd-82e1-ce103d691795" status: 404 len: 154 microversion: 2.1 time: 0.101614 Aug 31 12:43:05.989540 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 529/1068] 10.222.0.79 () {58 vars in 1416 bytes} [Wed Aug 31 12:43:05 2022] DELETE /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36/os-volume_attachments/f9d96859-e1dd-4cbd-82e1-ce103d691795 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:43:07.151223 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-39f0164c-efc7-410e-a56a-5e072a94c75c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:43:07.151900 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-39f0164c-efc7-410e-a56a-5e072a94c75c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:43:07.158777 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-39f0164c-efc7-410e-a56a-5e072a94c75c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:07.159295 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-39f0164c-efc7-410e-a56a-5e072a94c75c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:07.159730 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-39f0164c-efc7-410e-a56a-5e072a94c75c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:07.160422 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-39f0164c-efc7-410e-a56a-5e072a94c75c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:07.160876 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-39f0164c-efc7-410e-a56a-5e072a94c75c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:07.161307 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-39f0164c-efc7-410e-a56a-5e072a94c75c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:07.188025 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-39f0164c-efc7-410e-a56a-5e072a94c75c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Going to try to terminate instance {{(pid=120749) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:43:07.264563 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-39f0164c-efc7-410e-a56a-5e072a94c75c tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 204 len: 0 microversion: 2.1 time: 0.116951 Aug 31 12:43:07.265688 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 540/1069] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 31 12:43:07 2022] DELETE /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 12:43:07.273999 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-fc55c000-785c-4a8f-9371-e3cbb74279a8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:43:07.274606 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-fc55c000-785c-4a8f-9371-e3cbb74279a8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:43:07.282160 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fc55c000-785c-4a8f-9371-e3cbb74279a8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:07.282639 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fc55c000-785c-4a8f-9371-e3cbb74279a8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:07.283108 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fc55c000-785c-4a8f-9371-e3cbb74279a8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:07.283797 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fc55c000-785c-4a8f-9371-e3cbb74279a8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:07.284247 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fc55c000-785c-4a8f-9371-e3cbb74279a8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:07.284665 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-fc55c000-785c-4a8f-9371-e3cbb74279a8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:07.416740 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-fc55c000-785c-4a8f-9371-e3cbb74279a8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:43:07.425269 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-fc55c000-785c-4a8f-9371-e3cbb74279a8 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1555 microversion: 2.1 time: 0.155064 Aug 31 12:43:07.426017 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 530/1070] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:43:07 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:43:08.447665 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-b26aa7ea-ef5f-4d73-9678-6642cb65ffaf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:43:08.448364 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-b26aa7ea-ef5f-4d73-9678-6642cb65ffaf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:43:08.455579 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b26aa7ea-ef5f-4d73-9678-6642cb65ffaf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:08.456065 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b26aa7ea-ef5f-4d73-9678-6642cb65ffaf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:08.456496 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b26aa7ea-ef5f-4d73-9678-6642cb65ffaf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:08.457182 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b26aa7ea-ef5f-4d73-9678-6642cb65ffaf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:08.457635 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b26aa7ea-ef5f-4d73-9678-6642cb65ffaf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:08.458057 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-b26aa7ea-ef5f-4d73-9678-6642cb65ffaf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:08.589258 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-b26aa7ea-ef5f-4d73-9678-6642cb65ffaf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:43:08.597529 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-b26aa7ea-ef5f-4d73-9678-6642cb65ffaf tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1555 microversion: 2.1 time: 0.154069 Aug 31 12:43:08.598310 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 541/1071] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:43:08 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:43:09.621864 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-5fa4f50e-62c8-41bd-92a5-0d365f83c521 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:43:09.622429 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-5fa4f50e-62c8-41bd-92a5-0d365f83c521 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:43:09.629649 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5fa4f50e-62c8-41bd-92a5-0d365f83c521 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:09.630218 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5fa4f50e-62c8-41bd-92a5-0d365f83c521 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:09.630563 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5fa4f50e-62c8-41bd-92a5-0d365f83c521 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:09.631272 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5fa4f50e-62c8-41bd-92a5-0d365f83c521 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:09.631920 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5fa4f50e-62c8-41bd-92a5-0d365f83c521 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:09.632336 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-5fa4f50e-62c8-41bd-92a5-0d365f83c521 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:09.722802 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-5fa4f50e-62c8-41bd-92a5-0d365f83c521 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463ffd63f6d54b629e160c3476eae261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ba32b297b84802941b32e82f3a67e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:43:09.730654 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-5fa4f50e-62c8-41bd-92a5-0d365f83c521 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 200 len: 1513 microversion: 2.1 time: 0.112753 Aug 31 12:43:09.731394 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 531/1072] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:43:09 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 1513 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:43:09.771833 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-720176f1-daf6-44f1-b022-d43b429bf4e3 req-7ad200a6-43b7-4ee1-a7e8-f7e3993762ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4498593-a0a3-4d64-a784-cb171ef2ed36", "name": "network-vif-deleted", "tag": "053f2a29-0f5c-4365-8bc1-9f22a94101d9"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:43:09.782611 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-720176f1-daf6-44f1-b022-d43b429bf4e3 req-7ad200a6-43b7-4ee1-a7e8-f7e3993762ab service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:09.783243 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-720176f1-daf6-44f1-b022-d43b429bf4e3 req-7ad200a6-43b7-4ee1-a7e8-f7e3993762ab service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:09.783739 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-720176f1-daf6-44f1-b022-d43b429bf4e3 req-7ad200a6-43b7-4ee1-a7e8-f7e3993762ab service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:09.795847 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-720176f1-daf6-44f1-b022-d43b429bf4e3 req-7ad200a6-43b7-4ee1-a7e8-f7e3993762ab service nova] Creating event network-vif-deleted:053f2a29-0f5c-4365-8bc1-9f22a94101d9 for instance e4498593-a0a3-4d64-a784-cb171ef2ed36 on hv-cinder-85528 Aug 31 12:43:09.801043 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-720176f1-daf6-44f1-b022-d43b429bf4e3 req-7ad200a6-43b7-4ee1-a7e8-f7e3993762ab service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032930 Aug 31 12:43:09.801637 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 542/1073] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:43:10.753011 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-331b652a-bab1-4fb7-93de-13bff4ac36a6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:43:10.753578 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-331b652a-bab1-4fb7-93de-13bff4ac36a6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] [instance: e4498593-a0a3-4d64-a784-cb171ef2ed36] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:43:10.759900 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-331b652a-bab1-4fb7-93de-13bff4ac36a6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:10.760378 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-331b652a-bab1-4fb7-93de-13bff4ac36a6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:10.760805 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-331b652a-bab1-4fb7-93de-13bff4ac36a6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:10.761479 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-331b652a-bab1-4fb7-93de-13bff4ac36a6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:10.761925 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-331b652a-bab1-4fb7-93de-13bff4ac36a6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:10.762338 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-331b652a-bab1-4fb7-93de-13bff4ac36a6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:10.775672 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.wsgi [None req-331b652a-bab1-4fb7-93de-13bff4ac36a6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] HTTP exception thrown: Instance e4498593-a0a3-4d64-a784-cb171ef2ed36 could not be found. Aug 31 12:43:10.777170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-331b652a-bab1-4fb7-93de-13bff4ac36a6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Request method failure captured: Aug 31 12:43:10.777170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: request: GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 HTTP/1.1 Aug 31 12:43:10.777170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept: application/json Aug 31 12:43:10.777170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Accept-Encoding: identity Aug 31 12:43:10.777170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Connection: close Aug 31 12:43:10.777170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Length: 0 Aug 31 12:43:10.777170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Content-Type: application/json Aug 31 12:43:10.777170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Host: 10.222.0.79 Aug 31 12:43:10.777170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Openstack-System-Scope: None Aug 31 12:43:10.777170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: User-Agent: python-urllib3/1.26.12 Aug 31 12:43:10.777170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Auth-Token: gAAAAABjD1bjU_dgLbiwqp-IRVVGp4uB0Ethaomby6pXBGbo6cKu0202JcZEn5N5G8oXcGNUiU-ATjr_ZaifI6C61lGpYJkicVzxf-WTQyogqm0BVEEoNBqgDEEiDwFxElOMW7eWfL20jVFf8YZWMOh71DDYfXepKuqYHzFuscwhzGuwW-uS56w Aug 31 12:43:10.777170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Id: None Aug 31 12:43:10.777170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Domain-Name: None Aug 31 12:43:10.777170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Identity-Status: Confirmed Aug 31 12:43:10.777170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Is-Admin-Project: True Aug 31 12:43:10.777170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Id: default Aug 31 12:43:10.777170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Domain-Name: Default Aug 31 12:43:10.777170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Id: e8ba32b297b84802941b32e82f3a67e5 Aug 31 12:43:10.777170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Project-Name: tempest-TestMinimumBasicScenario-99332013 Aug 31 12:43:10.777170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Role: reader,member Aug 31 12:43:10.777170 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Roles: reader,member Aug 31 12:43:10.778962 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e8ba32b297b84802941b32e82f3a67e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e8ba32b297b84802941b32e82f3a67e5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e8ba32b297b84802941b32e82f3a67e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e8ba32b297b84802941b32e82f3a67e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:43:10.778962 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant: tempest-TestMinimumBasicScenario-99332013 Aug 31 12:43:10.778962 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Id: e8ba32b297b84802941b32e82f3a67e5 Aug 31 12:43:10.778962 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-Tenant-Name: tempest-TestMinimumBasicScenario-99332013 Aug 31 12:43:10.778962 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User: tempest-TestMinimumBasicScenario-99332013-project Aug 31 12:43:10.778962 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Id: default Aug 31 12:43:10.778962 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Domain-Name: Default Aug 31 12:43:10.778962 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Id: 463ffd63f6d54b629e160c3476eae261 Aug 31 12:43:10.778962 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: X-User-Name: tempest-TestMinimumBasicScenario-99332013-project Aug 31 12:43:10.778962 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: method: > Aug 31 12:43:10.778962 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: exception: Instance e4498593-a0a3-4d64-a784-cb171ef2ed36 could not be found. Aug 31 12:43:10.778962 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: action_args: {'id': 'e4498593-a0a3-4d64-a784-cb171ef2ed36'} Aug 31 12:43:10.780058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:43:10.780058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:43:10.780058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:43:10.780058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:43:10.780058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:43:10.780058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:43:10.780058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:43:10.780058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:43:10.780058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:43:10.780058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:43:10.780058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4498593-a0a3-4d64-a784-cb171ef2ed36 could not be found. Aug 31 12:43:10.780058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:43:10.780058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:43:10.780058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:43:10.780058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:43:10.780058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:43:10.780058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:43:10.780058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:43:10.780058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:43:10.780058 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:43:10.782260 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:43:10.782260 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:43:10.782260 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:43:10.782260 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:43:10.782260 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:43:10.782260 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:43:10.782260 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:43:10.782260 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4498593-a0a3-4d64-a784-cb171ef2ed36 could not be found. Aug 31 12:43:10.782260 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:43:10.782260 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:43:10.782260 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:43:10.782260 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:43:10.782260 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:43:10.782260 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:43:10.782260 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:43:10.782260 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:43:10.782260 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4498593-a0a3-4d64-a784-cb171ef2ed36 could not be found. Aug 31 12:43:10.782260 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: ERROR nova.api.openstack.wsgi Aug 31 12:43:10.783888 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-331b652a-bab1-4fb7-93de-13bff4ac36a6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Returning 404 to user: Instance e4498593-a0a3-4d64-a784-cb171ef2ed36 could not be found. {{(pid=120750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:43:10.783888 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-331b652a-bab1-4fb7-93de-13bff4ac36a6 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36" status: 404 len: 111 microversion: 2.1 time: 0.029653 Aug 31 12:43:10.783888 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 532/1074] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:43:10 2022] GET /compute/v2.1/servers/e4498593-a0a3-4d64-a784-cb171ef2ed36 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:43:10.789128 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-c9b70ab6-4d00-4cf9-94ce-1a49267a6296 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] Calling method '.version_select at 0x7f8d17228af0>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:43:10.808340 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-c9b70ab6-4d00-4cf9-94ce-1a49267a6296 tempest-TestMinimumBasicScenario-99332013 tempest-TestMinimumBasicScenario-99332013-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2059934916" status: 202 len: 0 microversion: 2.1 time: 0.023887 Aug 31 12:43:10.808916 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 543/1075] 10.222.0.79 () {58 vars in 1272 bytes} [Wed Aug 31 12:43:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2059934916 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:44:01.651181 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-3296a3cc-356e-4354-b6bd-7ef9facaf28a tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:44:01.651759 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-3296a3cc-356e-4354-b6bd-7ef9facaf28a tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:44:01.652648 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-4d25a72e-0607-4bef-9c9d-c69fc6948a15 req-a36ee6a4-b19d-446e-bda2-aead9f33c602 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68593769-d63a-425c-8988-3def34259a96", "tag": "c50ac0a0-bbf4-44a3-9255-25ee8afa88e4"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:44:01.654078 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_api:SELECT=14 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:44:01.654985 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG dbcounter [-] [120750] Writing DB stats nova_cell1:SELECT=30 {{(pid=120750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:44:01.655966 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:44:01.656120 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: Wed Aug 31 12:44:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 (ip 10.222.0.79) !!! Aug 31 12:44:01.663327 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:44:01.666016 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG dbcounter [-] [120749] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:44:01.666642 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3296a3cc-356e-4354-b6bd-7ef9facaf28a tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:44:01.667185 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3296a3cc-356e-4354-b6bd-7ef9facaf28a tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:44:01.667626 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3296a3cc-356e-4354-b6bd-7ef9facaf28a tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:44:01.668309 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3296a3cc-356e-4354-b6bd-7ef9facaf28a tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:44:01.668762 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3296a3cc-356e-4354-b6bd-7ef9facaf28a tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:44:01.669182 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-3296a3cc-356e-4354-b6bd-7ef9facaf28a tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:44:01.678586 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-4d25a72e-0607-4bef-9c9d-c69fc6948a15 req-a36ee6a4-b19d-446e-bda2-aead9f33c602 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:44:01.679103 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-4d25a72e-0607-4bef-9c9d-c69fc6948a15 req-a36ee6a4-b19d-446e-bda2-aead9f33c602 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:44:01.679528 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-4d25a72e-0607-4bef-9c9d-c69fc6948a15 req-a36ee6a4-b19d-446e-bda2-aead9f33c602 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:44:01.694283 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-4d25a72e-0607-4bef-9c9d-c69fc6948a15 req-a36ee6a4-b19d-446e-bda2-aead9f33c602 service nova] Creating event network-changed:c50ac0a0-bbf4-44a3-9255-25ee8afa88e4 for instance 68593769-d63a-425c-8988-3def34259a96 on hv-cinder-85528 Aug 31 12:44:01.699661 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-3296a3cc-356e-4354-b6bd-7ef9facaf28a tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Going to try to terminate instance {{(pid=120750) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:44:01.700443 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-4d25a72e-0607-4bef-9c9d-c69fc6948a15 req-a36ee6a4-b19d-446e-bda2-aead9f33c602 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051799 Aug 31 12:44:01.701725 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 544/1076] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:44:01.799618 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-3296a3cc-356e-4354-b6bd-7ef9facaf28a tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "DELETE /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 204 len: 0 microversion: 2.1 time: 0.153207 Aug 31 12:44:01.800509 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 533/1077] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 31 12:44:01 2022] DELETE /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:44:01.809832 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-8c1108c2-5fd1-4f7a-bfd6-51b8328fe8b2 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:44:01.810531 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-8c1108c2-5fd1-4f7a-bfd6-51b8328fe8b2 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:44:01.819462 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8c1108c2-5fd1-4f7a-bfd6-51b8328fe8b2 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:44:01.819960 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8c1108c2-5fd1-4f7a-bfd6-51b8328fe8b2 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:44:01.820395 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8c1108c2-5fd1-4f7a-bfd6-51b8328fe8b2 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:44:01.821128 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8c1108c2-5fd1-4f7a-bfd6-51b8328fe8b2 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:44:01.821569 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8c1108c2-5fd1-4f7a-bfd6-51b8328fe8b2 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:44:01.821990 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-8c1108c2-5fd1-4f7a-bfd6-51b8328fe8b2 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:44:01.968764 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.policy [None req-8c1108c2-5fd1-4f7a-bfd6-51b8328fe8b2 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120749) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:44:01.976881 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-8c1108c2-5fd1-4f7a-bfd6-51b8328fe8b2 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1569 microversion: 2.1 time: 0.171351 Aug 31 12:44:01.977468 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 545/1078] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:44:01 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:44:03.000209 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-f1e77cb2-ef4b-449f-942e-35a4c2d9756b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:44:03.001112 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-f1e77cb2-ef4b-449f-942e-35a4c2d9756b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:44:03.008855 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f1e77cb2-ef4b-449f-942e-35a4c2d9756b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:44:03.009343 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f1e77cb2-ef4b-449f-942e-35a4c2d9756b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:44:03.009773 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f1e77cb2-ef4b-449f-942e-35a4c2d9756b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:44:03.010475 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f1e77cb2-ef4b-449f-942e-35a4c2d9756b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:44:03.010968 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f1e77cb2-ef4b-449f-942e-35a4c2d9756b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:44:03.011392 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-f1e77cb2-ef4b-449f-942e-35a4c2d9756b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:44:03.261002 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-f1e77cb2-ef4b-449f-942e-35a4c2d9756b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:44:03.268748 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-f1e77cb2-ef4b-449f-942e-35a4c2d9756b tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1569 microversion: 2.1 time: 0.273206 Aug 31 12:44:03.269299 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 534/1079] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:44:02 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1569 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:44:03.921575 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [req-74e054f5-a819-454b-a24f-16259f2480ac req-ac6fd535-7662-4fb0-85f9-db37c0256712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68593769-d63a-425c-8988-3def34259a96", "name": "network-vif-deleted", "tag": "c50ac0a0-bbf4-44a3-9255-25ee8afa88e4"}]} {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:44:03.932469 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-74e054f5-a819-454b-a24f-16259f2480ac req-ac6fd535-7662-4fb0-85f9-db37c0256712 service nova] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:44:03.932961 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-74e054f5-a819-454b-a24f-16259f2480ac req-ac6fd535-7662-4fb0-85f9-db37c0256712 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:44:03.933373 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [req-74e054f5-a819-454b-a24f-16259f2480ac req-ac6fd535-7662-4fb0-85f9-db37c0256712 service nova] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:44:03.944880 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.compute.server_external_events [req-74e054f5-a819-454b-a24f-16259f2480ac req-ac6fd535-7662-4fb0-85f9-db37c0256712 service nova] Creating event network-vif-deleted:c50ac0a0-bbf4-44a3-9255-25ee8afa88e4 for instance 68593769-d63a-425c-8988-3def34259a96 on hv-cinder-85528 Aug 31 12:44:03.949465 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [req-74e054f5-a819-454b-a24f-16259f2480ac req-ac6fd535-7662-4fb0-85f9-db37c0256712 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031714 Aug 31 12:44:03.950055 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 546/1080] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 31 12:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:44:04.290278 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-801f61c0-64cb-42db-b934-d858686a507f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:44:04.291071 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.compute.api [None req-801f61c0-64cb-42db-b934-d858686a507f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120750) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:44:04.298904 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-801f61c0-64cb-42db-b934-d858686a507f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:44:04.299564 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-801f61c0-64cb-42db-b934-d858686a507f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:44:04.300112 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-801f61c0-64cb-42db-b934-d858686a507f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:44:04.301478 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-801f61c0-64cb-42db-b934-d858686a507f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:44:04.302084 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-801f61c0-64cb-42db-b934-d858686a507f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:44:04.302641 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-801f61c0-64cb-42db-b934-d858686a507f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:44:04.337134 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-801f61c0-64cb-42db-b934-d858686a507f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:44:04.337704 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-801f61c0-64cb-42db-b934-d858686a507f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:44:04.338151 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG oslo_concurrency.lockutils [None req-801f61c0-64cb-42db-b934-d858686a507f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:44:04.338744 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.objects.instance [None req-801f61c0-64cb-42db-b934-d858686a507f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lazy-loading 'fault' on Instance uuid 68593769-d63a-425c-8988-3def34259a96 {{(pid=120750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:44:04.383490 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.policy [None req-801f61c0-64cb-42db-b934-d858686a507f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc9e1e27ad3412e856dfda13a4f7e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92cfd0189e5d478ca95f1b5a38809030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120750) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:44:04.391360 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-801f61c0-64cb-42db-b934-d858686a507f tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 200 len: 1224 microversion: 2.1 time: 0.105147 Aug 31 12:44:04.391971 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 535/1081] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:44:04 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:44:05.414714 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-a25d7871-6a2d-4d31-bcbc-c7e76a5b9896 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '>' {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:44:05.415431 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.compute.api [None req-a25d7871-6a2d-4d31-bcbc-c7e76a5b9896 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] [instance: 68593769-d63a-425c-8988-3def34259a96] Fetching instance by UUID {{(pid=120749) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:44:05.421586 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a25d7871-6a2d-4d31-bcbc-c7e76a5b9896 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:44:05.422070 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a25d7871-6a2d-4d31-bcbc-c7e76a5b9896 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:44:05.422503 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a25d7871-6a2d-4d31-bcbc-c7e76a5b9896 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:44:05.423220 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a25d7871-6a2d-4d31-bcbc-c7e76a5b9896 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Acquiring lock "a65646e1-71cc-4e16-b061-01c594ea7d86" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:44:05.423674 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a25d7871-6a2d-4d31-bcbc-c7e76a5b9896 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:44:05.424098 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG oslo_concurrency.lockutils [None req-a25d7871-6a2d-4d31-bcbc-c7e76a5b9896 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Lock "a65646e1-71cc-4e16-b061-01c594ea7d86" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:44:05.437347 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.wsgi [None req-a25d7871-6a2d-4d31-bcbc-c7e76a5b9896 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] HTTP exception thrown: Instance 68593769-d63a-425c-8988-3def34259a96 could not be found. Aug 31 12:44:05.438975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-a25d7871-6a2d-4d31-bcbc-c7e76a5b9896 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Request method failure captured: Aug 31 12:44:05.438975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: request: GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 HTTP/1.1 Aug 31 12:44:05.438975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept: application/json Aug 31 12:44:05.438975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Accept-Encoding: identity Aug 31 12:44:05.438975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Connection: close Aug 31 12:44:05.438975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Length: 0 Aug 31 12:44:05.438975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Content-Type: application/json Aug 31 12:44:05.438975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Host: 10.222.0.79 Aug 31 12:44:05.438975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: Openstack-System-Scope: None Aug 31 12:44:05.438975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: User-Agent: python-urllib3/1.26.12 Aug 31 12:44:05.438975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Auth-Token: gAAAAABjD1aITmKXy69fXohE1nLW5bmKvY5Xa2mzoQTmUn61G60CCXKwsIe-7XkADkXSDp39dOFs3GH8Ke6xReTmCqD4ymfV7ikDjJu6UeqpYzMqJvE6d41wGA1lM1P0wNxw7uv0wlCEeg8tVlkBc8AR5N36pLI1H4sAMKvKMq7xZGqwVRp0V6k Aug 31 12:44:05.438975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Id: None Aug 31 12:44:05.438975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Domain-Name: None Aug 31 12:44:05.438975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Identity-Status: Confirmed Aug 31 12:44:05.438975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Is-Admin-Project: True Aug 31 12:44:05.438975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Id: default Aug 31 12:44:05.438975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Domain-Name: Default Aug 31 12:44:05.438975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Id: 92cfd0189e5d478ca95f1b5a38809030 Aug 31 12:44:05.438975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Project-Name: tempest-TestShelveInstance-1269034528 Aug 31 12:44:05.438975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Role: reader,member Aug 31 12:44:05.438975 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Roles: reader,member Aug 31 12:44:05.440844 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/92cfd0189e5d478ca95f1b5a38809030"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_92cfd0189e5d478ca95f1b5a38809030", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/92cfd0189e5d478ca95f1b5a38809030"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/92cfd0189e5d478ca95f1b5a38809030"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Aug 31 12:44:05.440844 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant: tempest-TestShelveInstance-1269034528 Aug 31 12:44:05.440844 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Id: 92cfd0189e5d478ca95f1b5a38809030 Aug 31 12:44:05.440844 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-Tenant-Name: tempest-TestShelveInstance-1269034528 Aug 31 12:44:05.440844 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User: tempest-TestShelveInstance-1269034528-project Aug 31 12:44:05.440844 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Id: default Aug 31 12:44:05.440844 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Domain-Name: Default Aug 31 12:44:05.440844 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Id: 4bc9e1e27ad3412e856dfda13a4f7e51 Aug 31 12:44:05.440844 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: X-User-Name: tempest-TestShelveInstance-1269034528-project Aug 31 12:44:05.440844 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: method: > Aug 31 12:44:05.440844 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: exception: Instance 68593769-d63a-425c-8988-3def34259a96 could not be found. Aug 31 12:44:05.440844 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: action_args: {'id': '68593769-d63a-425c-8988-3def34259a96'} Aug 31 12:44:05.442644 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: {{(pid=120749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:44:05.442644 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:44:05.442644 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:44:05.442644 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:44:05.442644 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:44:05.442644 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:44:05.442644 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:44:05.442644 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:44:05.442644 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:44:05.442644 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:44:05.442644 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68593769-d63a-425c-8988-3def34259a96 could not be found. Aug 31 12:44:05.442644 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:44:05.442644 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:44:05.442644 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:44:05.442644 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:44:05.442644 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:44:05.442644 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:44:05.442644 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:44:05.442644 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:44:05.442644 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:44:05.444454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:44:05.444454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:44:05.444454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:44:05.444454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:44:05.444454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:44:05.444454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:44:05.444454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:44:05.444454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68593769-d63a-425c-8988-3def34259a96 could not be found. Aug 31 12:44:05.444454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:44:05.444454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:44:05.444454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:44:05.444454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:44:05.444454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:44:05.444454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:44:05.444454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:44:05.444454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:44:05.444454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68593769-d63a-425c-8988-3def34259a96 could not be found. Aug 31 12:44:05.444454 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: ERROR nova.api.openstack.wsgi Aug 31 12:44:05.446144 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: DEBUG nova.api.openstack.wsgi [None req-a25d7871-6a2d-4d31-bcbc-c7e76a5b9896 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Returning 404 to user: Instance 68593769-d63a-425c-8988-3def34259a96 could not be found. {{(pid=120749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:44:05.446144 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: INFO nova.api.openstack.requestlog [None req-a25d7871-6a2d-4d31-bcbc-c7e76a5b9896 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96" status: 404 len: 111 microversion: 2.1 time: 0.030503 Aug 31 12:44:05.446144 dv-cinder-855288-4-iscsi devstack@n-api.service[120749]: [pid: 120749|app: 0|req: 547/1082] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 31 12:44:05 2022] GET /compute/v2.1/servers/68593769-d63a-425c-8988-3def34259a96 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:44:05.598530 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: DEBUG nova.api.openstack.wsgi [None req-bca85e46-25d8-487a-945f-e55fe73f1843 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] Calling method '.version_select at 0x7f8d170c0940>' {{(pid=120750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:44:05.618416 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: INFO nova.api.openstack.requestlog [None req-bca85e46-25d8-487a-945f-e55fe73f1843 tempest-TestShelveInstance-1269034528 tempest-TestShelveInstance-1269034528-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-173108296" status: 202 len: 0 microversion: 2.1 time: 0.023986 Aug 31 12:44:05.619203 dv-cinder-855288-4-iscsi devstack@n-api.service[120750]: [pid: 120750|app: 0|req: 536/1083] 10.222.0.79 () {58 vars in 1251 bytes} [Wed Aug 31 12:44:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-173108296 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)